Re: [Dspace-tech] Question about deploying the DSpace application
Hi there! Thanks very much for your always helpful responses! Just one question to clarify: I'm assuming that once we would copy the /webapps directory over to the Production machine, we will have to run ant, but not mvn? Is that correct? Of course we have to have our dspace.cfg file configured for Production, but are there any other files that will need to be edited once they're copied over to Production? Thanks again for your prompt reply! Best regards, Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.gov -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Monday, July 22, 2013 11:28 AM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech (dspace-tech@lists.sourceforge.net) Subject: Re: [Dspace-tech] Question about deploying the DSpace application On Mon, Jul 22, 2013 at 5:08 PM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.gov wrote: Here are my questions: 1. Why don’t we deploy the .war file like we used to? Why the change, what’s the difference in doing it this way, and are there any benefits? Hi Sue, I'm not an expert in this, so I'll leave someone else answer it: http://stackoverflow.com/questions/3906881/advantages-disadvantages-to-exploded-wars My personal point of view: With WARs, Tomcat would detect when you deleted/updated the WAR and undeploy/redeploy it. With the new recommended approach, where you configure Contexts in individual context fragments (.xml files), you can simply delete/touch the context fragment. 2. We are modifying the structure of our new DSpace sites, to include a separate PostgreSQL server and not having the DSpace source code on the Production server. The SAs have asked me to find out: a. If we can deploy DSpace 3.1 with a .war file that can just be copied over from the Dev machine once we’re ready to go to Production? The webapps (whether WARs or exploded) will be the same. Note the difference in configuration: You only need to change dspace.hostname and possibly dspace.baseUrl and dspace.url. Then there are also other directories in [dspace], but after the upgrade, if you're only redeploying changed code, you most likely don't need to change anything there. For the upgrade itself, all the changes to these directories will be covered in the upgrading docs. b. Are there any other ways of doing this so the DSpace source code is NOT on the Production server? Sure, you could actually use the binary distribution and never touch the actual source code. You still need to do mvn package, though, to create the webapps. Once you've upgraded and you only want to redeploy changed webapps from dev to production, you could skip the ant step and just copy over the webapps manually. I hope this answers your questions, let me know if it doesn't. In some parts I felt like I could go into more detail but I didn't want to flood you with too much information. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- See everything from the browser to the database with AppDynamics Get end-to-end visibility with application monitoring from AppDynamics Isolate bottlenecks and diagnose root cause in seconds. Start your free trial of AppDynamics Pro today! http://pubads.g.doubleclick.net/gampad/clk?id=48808831iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Help in indexing dspace3
Try changing your Java parameters in dsrun to: java -Xms2048m -Xmx3072m -Xss512k -Dfile.encoding=UTF-8 -classpath $FULLPATH $@ Good luck! Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.gov -Original Message- From: mohammadpourf...@gmail.com [mailto:mohammadpourf...@gmail.com] Sent: Friday, July 12, 2013 6:07 AM To: Thornton, Susan M. (LARC-B702)[LITES] Subject: Help in indexing dspace3 Dear Susan, I have a question and i will be grateful if you can help me. When i want to index my dspace 3 with command (dspace index-init or index-init -r -v), I encounter a error: Exception: Java heap space java.lang.OutOfMemoryError: Java heap space ... I tried so much to solve this. I set Java_OPS and catalina in catalina.sh, I tried increasing java memory from control panel (java), I tried environmental path for JAVA_OPS, I changed seach.maxinteger to -1 in dspace.cfg, but i did not get answer. I use xampp and also tried tomcat separately but ... Please if you can help me on this subject. Many thanks for your attention. _ Sent from http://dspace.2283337.n4.nabble.com -- See everything from the browser to the database with AppDynamics Get end-to-end visibility with application monitoring from AppDynamics Isolate bottlenecks and diagnose root cause in seconds. Start your free trial of AppDynamics Pro today! http://pubads.g.doubleclick.net/gampad/clk?id=48808831iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Help in indexing dspace3
Sorry - I didn't see you were using DSpace version 3 - try changing your JAVA_OPTS in /bin/dspace to: JAVA_OPTS=-Xms2048m -Xmx3072m -Xss512k -Dfile.encoding=UTF-8 Pls. let us know if this works for you. Thanks, Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.gov -Original Message- From: mohammadpourf...@gmail.com [mailto:mohammadpourf...@gmail.com] Sent: Friday, July 12, 2013 6:07 AM To: Thornton, Susan M. (LARC-B702)[LITES] Subject: Help in indexing dspace3 Dear Susan, I have a question and i will be grateful if you can help me. When i want to index my dspace 3 with command (dspace index-init or index-init -r -v), I encounter a error: Exception: Java heap space java.lang.OutOfMemoryError: Java heap space ... I tried so much to solve this. I set Java_OPS and catalina in catalina.sh, I tried increasing java memory from control panel (java), I tried environmental path for JAVA_OPS, I changed seach.maxinteger to -1 in dspace.cfg, but i did not get answer. I use xampp and also tried tomcat separately but ... Please if you can help me on this subject. Many thanks for your attention. _ Sent from http://dspace.2283337.n4.nabble.com -- See everything from the browser to the database with AppDynamics Get end-to-end visibility with application monitoring from AppDynamics Isolate bottlenecks and diagnose root cause in seconds. Start your free trial of AppDynamics Pro today! http://pubads.g.doubleclick.net/gampad/clk?id=48808831iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Question on new feature in DSpace version 3.1 - Type-based submissions (show or hide submission fields based on type of content)
Hi, I have a question about one of the New features and Improvements listed for DSpace version 3.1: Type-based submissionshttps://wiki.duraspace.org/display/DSDOC3x/Submission+User+Interface#SubmissionUserInterface-ItemtypeBasedMetadataCollection (show or hide submission fields based on type of content) Way back in at least version 1.5, we had the capability to customize input screens in the online submission process (which we did) based on the collection to which the Item was being added. Can someone tell me what the difference is between the old capability and this new one? Thanks in advance, Best regards, Sue - Sue Thornton Software Developer/DBA SGT, Inc. ~ LITES Contract NASA Langley Research Center 130 Research Drive, Hampton, VA. 23666 Office: (757) 224-4130 Mobile: (757) 506-9903 Fax: (757) 224-4001 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov sthorn...@sgt-inc.commailto:sthorn...@sgt-inc.com inline: image001.gif-- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace 3.x configuration questions
First of all, I want to say Thank you to Sean and Bram for answering some questions for me regarding the email below. The answer to #2 is, I believe, yes, but for the dspace.cfg file. We'd either have to re-do it or have a Prod. and a Test version. I think we can work that out. I believe our PostgreSQL server is going to work nicely and will only be a matter of having the correct configuration property in dspace.cfg. The only question I still need answered - and please forgive me if you answered it and I didn't catch on since I've always used IPlanet is this: Do most DSpace installations use DSpace with standalone Tomcat or Apache webserver with a connector to Tomcat? Again -thanks for the help. I'm learning new stuff every day. :) Best regards, Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: Thornton, Susan M. (LARC-B702)[LITES] [mailto:susan.m.thorn...@nasa.gov] Sent: Thursday, June 06, 2013 6:52 PM To: dspace-tech (dspace-tech@lists.sourceforge.net) Subject: [Dspace-tech] DSpace 3.x configuration questions Hello, We are gearing up to upgrade two of our production DSpace instances in the near future. One instance is currently at DSpace version 1.5.1/JSPUI and the other is at 1.7.1/JSPUI. As part of these upgrades, we are going to be making the following DSpace application configuration changes: 1. Switch from using IPlanet web server to Apache Tomcat 2. Implement a standalone server on which the PostgreSQL databases will reside (we're separating the database from the application) With these new configuration changes, we have some questions: 1. In IPlanet, we've always used a single instance of the webserver, with multiple virtual servers running under it and we plan to continue this set-up. IPlanet has a nice GUI web interface and it's always been easy to set up and maintain these multiple instances. Our question is this: Is this approach going to work for us with Apache Tomcat? Would it be better for us to use standalone Tomcat or the Apache webserver with a connector to Tomcat? What do most DSpace installations use? Any recommendations? Also, is there a GUI interface for Tomcat? 2. Since we first implemented DSpace back in 2005, we've made a considerable number of code customizations - most are presentation layer (look and feel) changes including mandates for things we must have on government web sites; and some are business logic changes. In the past, when we have finished testing a new version of DSpace and begin our Production implementation, we've always created a new directory for the source on the Production server and then copied the source directory from Test to Production. We then make the dspace.cfg file changes, etc, etc., then assemble and compile the application. So basically we are reinstalling DSpace on the Production server. I was asked if we could just copy over the executable files to the Production server, for security reasons, and somehow I'm thinking this would be difficult, if not impossible. Has anyone done this? Thoughts? One other thing...we will likely implement the JSPUI version of DSpace 3.x in the smaller of the two instances, and maybe bite the bullet and implement the XMLUI version of 3.x in our large instance (currently 195,673 Items and 188,024 documents and growing daily). It's making me a little nervous that we're still so far behind version-wise with the one DSpace instance AND that more and more folks seem to be implementing the XMLUI interface. We don't like being left behind. :) Thanks in advance, Sue - Sue Thornton Software Developer/DBA SGT, Inc. ~ LITES Contract NASA Langley Research Center 130 Research Drive, Hampton, VA. 23666 Office: (757) 224-4130 Mobile: (757) 506-9903 Fax: (757) 224-4001 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov sthorn...@sgt-inc.commailto:sthorn...@sgt-inc.com inline: image002.gif-- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] DSpace 3.x configuration questions
Hello, We are gearing up to upgrade two of our production DSpace instances in the near future. One instance is currently at DSpace version 1.5.1/JSPUI and the other is at 1.7.1/JSPUI. As part of these upgrades, we are going to be making the following DSpace application configuration changes: 1. Switch from using IPlanet web server to Apache Tomcat 2. Implement a standalone server on which the PostgreSQL databases will reside (we're separating the database from the application) With these new configuration changes, we have some questions: 1. In IPlanet, we've always used a single instance of the webserver, with multiple virtual servers running under it and we plan to continue this set-up. IPlanet has a nice GUI web interface and it's always been easy to set up and maintain these multiple instances. Our question is this: Is this approach going to work for us with Apache Tomcat? Would it be better for us to use standalone Tomcat or the Apache webserver with a connector to Tomcat? What do most DSpace installations use? Any recommendations? Also, is there a GUI interface for Tomcat? 2. Since we first implemented DSpace back in 2005, we've made a considerable number of code customizations - most are presentation layer (look and feel) changes including mandates for things we must have on government web sites; and some are business logic changes. In the past, when we have finished testing a new version of DSpace and begin our Production implementation, we've always created a new directory for the source on the Production server and then copied the source directory from Test to Production. We then make the dspace.cfg file changes, etc, etc., then assemble and compile the application. So basically we are reinstalling DSpace on the Production server. I was asked if we could just copy over the executable files to the Production server, for security reasons, and somehow I'm thinking this would be difficult, if not impossible. Has anyone done this? Thoughts? One other thing...we will likely implement the JSPUI version of DSpace 3.x in the smaller of the two instances, and maybe bite the bullet and implement the XMLUI version of 3.x in our large instance (currently 195,673 Items and 188,024 documents and growing daily). It's making me a little nervous that we're still so far behind version-wise with the one DSpace instance AND that more and more folks seem to be implementing the XMLUI interface. We don't like being left behind. :) Thanks in advance, Sue - Sue Thornton Software Developer/DBA SGT, Inc. ~ LITES Contract NASA Langley Research Center 130 Research Drive, Hampton, VA. 23666 Office: (757) 224-4130 Mobile: (757) 506-9903 Fax: (757) 224-4001 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov sthorn...@sgt-inc.commailto:sthorn...@sgt-inc.com inline: image001.gif-- How ServiceNow helps IT people transform IT departments: 1. A cloud service to automate IT design, transition and operations 2. Dashboards that offer high-level views of enterprise services 3. A single system of record for all IT processes http://p.sf.net/sfu/servicenow-d2d-j___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace: Internal Server Error
Wonderful! The dspace-tech list is an invaluable tool for DSpace administrators and developers!! Best regards, Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: Seun Ojedeji [mailto:seun.ojed...@gmail.com] Sent: Tuesday, May 28, 2013 5:29 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech Subject: Re: [Dspace-tech] DSpace: Internal Server Error Thanks Susan, You were right...that did the trick! Cheers! On Tue, May 28, 2013 at 7:24 PM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: You have a Java Heap Space error which basically means your application is out of memory. Try stopping and restarting your web server. This usually clears up the problem for my site. Also, consider allowing the JVM to use more memory using the -Xmx argument of the java command. See http://blogs.opcodesolutions.com/roller/java/entry/solve_java_lang_outofmemoryerror_java for more information. Best regards, Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: Seun Ojedeji [mailto:seun.ojed...@gmail.commailto:seun.ojed...@gmail.com] Sent: Tuesday, May 28, 2013 1:22 PM To: dspace-tech Subject: [Dspace-tech] DSpace: Internal Server Error Hello, I am receiving error message as below. Any idea on what could be the cause and how I may fix this? Thanks An internal server error occurred on http://repository.fuoye.edu.ng: Date: 5/28/13 5:14 PM Session ID: 8F60537C87F88B2FA76EC2645BB4DAF7 User: Anonymous IP address: 66.249.75.180 -- URL Was: http://repository.fuoye.edu.ng/handle/123456789/112/browse?type=subjectvalue=Adsorption/Absorptionsort_by=1order=ASCrpp=45etal=0submit_browse=Update -- Method: GET -- Parameters were: -- rpp: 45 -- order: ASC -- sort_by: 1 -- value: Adsorption/Absorption -- submit_browse: Update -- etal: 0 -- type: subject Exception: javax.servlet.ServletException: javax.servlet.ServletException: org.apache.jasper.JasperException: javax.servlet.ServletException: java.lang.OutOfMemoryError: Java heap space at org.dspace.utils.servlet.DSpaceWebappServletFilter.doFilter(DSpaceWebappServletFilter.java:85) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:646) at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:436) at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:374) at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:302) at org.dspace.app.webui.servlet.HandleServlet.doDSGet(HandleServlet.java:259) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:119) at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:67) at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.dspace.utils.servlet.DSpaceWebappServletFilter.doFilter(DSpaceWebappServletFilter.java:78) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) at java.lang.Thread.run(Thread.java:679) Caused by: javax.servlet.ServletException
Re: [Dspace-tech] xmlui gallery theme search error and unrecognizable characters problem
A server response code 404 means it can't find the resource/page you're trying to invoke. Look in the dspace.log(s) to see if there is any additional information about the error (there likely will be). You can also look in the server error and/or access log(s) to see exactly what's happening. Sorry - not sure about the strange characters! Good luck! Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.gov -Original Message- From: ggxky [mailto:iori1...@msn.com] Sent: Tuesday, May 28, 2013 11:22 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] xmlui gallery theme search error and unrecognizable characters problem Hi,i recently just installed xmlui gallery theme on my Dspace3.0 . but the search function have problem.these are my screenshots. when i click go button http://dspace.2283337.n4.nabble.com/file/n4664438/Untitled20130529111708.png will go to this page http://dspace.2283337.n4.nabble.com/file/n4664438/Untitled20130529111734.png and also after i login,some funny characters appears above the profile http://dspace.2283337.n4.nabble.com/file/n4664438/Untitled20130529111749.png sorry for my poor english , please help me..thx! -- View this message in context: http://dspace.2283337.n4.nabble.com/xmlui-gallery-theme-search-error-and-unrecognizable-characters-problem-tp4664438.html Sent from the DSpace - Tech mailing list archive at Nabble.com. -- Introducing AppDynamics Lite, a free troubleshooting tool for Java/.NET Get 100% visibility into your production application - at no cost. Code-level diagnostics for performance bottlenecks with 2% overhead Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap1 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Introducing AppDynamics Lite, a free troubleshooting tool for Java/.NET Get 100% visibility into your production application - at no cost. Code-level diagnostics for performance bottlenecks with 2% overhead Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap1 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace: Internal Server Error
You have a Java Heap Space error which basically means your application is out of memory. Try stopping and restarting your web server. This usually clears up the problem for my site. Also, consider allowing the JVM to use more memory using the -Xmx argument of the java command. See http://blogs.opcodesolutions.com/roller/java/entry/solve_java_lang_outofmemoryerror_java for more information. Best regards, Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: Seun Ojedeji [mailto:seun.ojed...@gmail.com] Sent: Tuesday, May 28, 2013 1:22 PM To: dspace-tech Subject: [Dspace-tech] DSpace: Internal Server Error Hello, I am receiving error message as below. Any idea on what could be the cause and how I may fix this? Thanks An internal server error occurred on http://repository.fuoye.edu.ng: Date: 5/28/13 5:14 PM Session ID: 8F60537C87F88B2FA76EC2645BB4DAF7 User: Anonymous IP address: 66.249.75.180 -- URL Was: http://repository.fuoye.edu.ng/handle/123456789/112/browse?type=subjectvalue=Adsorption/Absorptionsort_by=1order=ASCrpp=45etal=0submit_browse=Update -- Method: GET -- Parameters were: -- rpp: 45 -- order: ASC -- sort_by: 1 -- value: Adsorption/Absorption -- submit_browse: Update -- etal: 0 -- type: subject Exception: javax.servlet.ServletException: javax.servlet.ServletException: org.apache.jasper.JasperException: javax.servlet.ServletException: java.lang.OutOfMemoryError: Java heap space at org.dspace.utils.servlet.DSpaceWebappServletFilter.doFilter(DSpaceWebappServletFilter.java:85) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:646) at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:436) at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:374) at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:302) at org.dspace.app.webui.servlet.HandleServlet.doDSGet(HandleServlet.java:259) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:119) at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:67) at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.dspace.utils.servlet.DSpaceWebappServletFilter.doFilter(DSpaceWebappServletFilter.java:78) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) at java.lang.Thread.run(Thread.java:679) Caused by: javax.servlet.ServletException: org.apache.jasper.JasperException: javax.servlet.ServletException: java.lang.OutOfMemoryError: Java heap space at org.dspace.utils.servlet.DSpaceWebappServletFilter.doFilter(DSpaceWebappServletFilter.java:85) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:646) at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:436) at
Re: [Dspace-tech] Postgres configuration with DSpace
Wow. Thanks for all the info Peter! Can you tell me what kind of special configuration this took, or is it all specified in the dspace.cfg file? That would be great if it is! Thanks again, Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: Peter Dietz [mailto:pdiet...@gmail.com] Sent: Friday, May 17, 2013 1:02 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech (dspace-tech@lists.sourceforge.net); Dedmond, Nicole K. (LARC-B702)[LITES] Subject: Re: [Dspace-tech] Postgres configuration with DSpace Hi Sue, Here at Ohio State Libraries we've gone through a server refactoring, trying to improve DSpace performance, by reducing server load, and its worked really well. So, about a year ago, our server situation was a Production DSpace server running everything: Apache, Tomcat, Postgres, SOLR, Elastic Search. An incoming user request hit, makes the server's apache process shuffle it to tomcat, tomcat then has the DSpace code do some logic, which probably makes a request to the database, and by the end, the event gets logged into SOLR and Elastic Search. At each point, each service is competing for server resources and attention. So, we have changed things, and now have a separate Apache server, a separate Postgres server, a separate Elastic Search server, and we plan to sunset using SOLR in the next few months. · The apache server is now the central entry point for all of our Library webapps, theres several dozen things running through it, and all it does is hand off requests more or less. · The postgres server, is currently also sitting on the same server as our MySQL server (for LAMP apps), and its running fine enough. We have configured our production-dspace and staging-dspace to use our centralized postgres server to do all the postgres stuff. · We've pulled Elastic Search off of our dspace server, and that actually made the most performance improvement (you probably don't use elastic search statistics, so dont worry about that one). I don't think we have cold hard data of how beneficial this was, but, there's much less on-call 2am issues to respond to. Each server is siloed, and does one thing. When a request comes in, each server does what it needs to, and finishes, not holding things open, waiting for resources to free up, then getting back to it. We've been making tons of DSpace-code modifications to speed up certain requests (i.e. login, /submissions page, community/collection list, start a new submission - select collection step), but, I do attribute a better server architecture too. If your database ever became the bottleneck, then you would be able to clearly identify what the issue are. Disk IO, network traffic, CPU, memory, for that one box. As opposed to getting mixed signals from tomcat also running on the same box. One thing that I believe postgres does really well, but haven't used it in practice, is clustering. If you run into problems, and need to scale, you could add multiple postgres servers to form a pool, and they will distribute the work-load, automatically become replicas, and lots of magic. I think thats called Postgres-XC. Peter Dietz On Fri, May 17, 2013 at 12:42 PM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: [cid:image001.gif@01CE5549.D44AAB80] Hello, Can anyone tell me if it’s a workable solution to put Postgres on a separate server from your Dspace application? In the past, we’ve had them on the same server, but are considering configuring a Postgres-only server so that we don’t have Postgres instances all over the place. We currently have most of our Dspace instances on Sun Solaris 10/Unix machines. If this is possible (I’m thinking it is), can anyone list pros and cons of implementing this configuration? Are they any performance issues we need to be aware of, etc? Thanks in advance, Sue - Sue Thornton Software Developer/DBA SGT, Inc. ~ LITES Contract NASA Langley Research Center 130 Research Drive, Hampton, VA. 23666 Office: (757) 224-4130tel:%28757%29%20224-4130 Mobile: (757) 506-9903tel:%28757%29%20506-9903 Fax: (757) 224-4001tel:%28757%29%20224-4001 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov sthorn...@sgt-inc.commailto:sthorn...@sgt-inc.com -- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu
Re: [Dspace-tech] How to change maximum file size to be uploaded in dspace
Do keep in mind that, according to some testing we've done, the largest file size you can upload online is 2GB. If a file is over that size, it will have to be imported into your repository via the batch/ItemImport script. I believe this limit is more browser/network-related than Dspace application-related. Awhile back, we did some testing of importing large files into Dspace via the batch interface and we were able to concurrently load a 3, 4, 5, and 6GB in under 11 seconds. I consider that to be screaming fast. :) Best regards, Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: jayachandra B [mailto:jayachandra1...@gmail.com] Sent: Saturday, May 18, 2013 4:46 AM To: Lighton Phiri Cc: dspace-tech Subject: Re: [Dspace-tech] How to change maximum file size to be uploaded in dspace Thank you On Sat, May 18, 2013 at 2:02 PM, Lighton Phiri lighton.ph...@gmail.commailto:lighton.ph...@gmail.com wrote: Hello, You need to change the 'upload.max' parameter in dspace.cfg [1]. The default limit is 512mb and a negative value will result in no limit being set. [1] https://wiki.duraspace.org/display/DSDOC18/Configuration#Configuration-JSPUIUploadFileSettings Lighton Phiri http://lightonphiri.org On 18 May 2013 08:15, jayachandra B jayachandra1...@gmail.commailto:jayachandra1...@gmail.com wrote: Hi, I am using dspace 1.8.2 jspui, How to change the files size to be uploaded in dspace. -- Regards Jayachandra -- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu/alienvault_d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Regards Jayachandra -- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu/alienvault_d2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] How to change maximum file size to be uploaded in dspace
Sorry, I meant to say 2GB. Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: Thornton, Susan M. (LARC-B702)[LITES] [mailto:susan.m.thorn...@nasa.gov] Sent: Monday, May 20, 2013 11:10 AM To: jayachandra B; Lighton Phiri Cc: dspace-tech Subject: Re: [Dspace-tech] How to change maximum file size to be uploaded in dspace Do keep in mind that, according to some testing we've done, the largest file size you can upload online is 2GB. If a file is over that size, it will have to be imported into your repository via the batch/ItemImport script. I believe this limit is more browser/network-related than Dspace application-related. Awhile back, we did some testing of importing large files into Dspace via the batch interface and we were able to concurrently load a 3, 4, 5, and 6GB in under 11 seconds. I consider that to be screaming fast. :) Best regards, Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: jayachandra B [mailto:jayachandra1...@gmail.com] Sent: Saturday, May 18, 2013 4:46 AM To: Lighton Phiri Cc: dspace-tech Subject: Re: [Dspace-tech] How to change maximum file size to be uploaded in dspace Thank you On Sat, May 18, 2013 at 2:02 PM, Lighton Phiri lighton.ph...@gmail.commailto:lighton.ph...@gmail.com wrote: Hello, You need to change the 'upload.max' parameter in dspace.cfg [1]. The default limit is 512mb and a negative value will result in no limit being set. [1] https://wiki.duraspace.org/display/DSDOC18/Configuration#Configuration-JSPUIUploadFileSettings Lighton Phiri http://lightonphiri.org On 18 May 2013 08:15, jayachandra B jayachandra1...@gmail.commailto:jayachandra1...@gmail.com wrote: Hi, I am using dspace 1.8.2 jspui, How to change the files size to be uploaded in dspace. -- Regards Jayachandra -- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu/alienvault_d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Regards Jayachandra -- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu/alienvault_d2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Postgres configuration with DSpace
Thanks again Peter!! Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: Peter Dietz [mailto:pdiet...@gmail.com] Sent: Monday, May 20, 2013 11:25 AM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech (dspace-tech@lists.sourceforge.net); Dedmond, Nicole K. (LARC-B702)[LITES] Subject: Re: [Dspace-tech] Postgres configuration with DSpace Its all in the jdbc string. So, yes, in dspace.cfg # URL for connecting to database db.url = jdbc:postgresql://myPGserver123.university.edu:5432/dspace-prodhttp://myPGserver123.university.edu:5432/dspace-prod Before restarting your servlet container, you can change the DB settings in dspace.cfg, and test with: dspace/bin/dspace test-database In case you've got firewall issues, its best to address that before needing to change dspace. We migrated a staging instance before moving production. Peter Dietz On Mon, May 20, 2013 at 11:04 AM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: Wow. Thanks for all the info Peter! Can you tell me what kind of special configuration this took, or is it all specified in the dspace.cfg file? That would be great if it is! Thanks again, Sue Sue Thornton Office: (757) 224-4130tel:%28757%29%20224-4130 Mobile: (757) 506-9903tel:%28757%29%20506-9903 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: Peter Dietz [mailto:pdiet...@gmail.commailto:pdiet...@gmail.com] Sent: Friday, May 17, 2013 1:02 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech (dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net); Dedmond, Nicole K. (LARC-B702)[LITES] Subject: Re: [Dspace-tech] Postgres configuration with DSpace Hi Sue, Here at Ohio State Libraries we've gone through a server refactoring, trying to improve DSpace performance, by reducing server load, and its worked really well. So, about a year ago, our server situation was a Production DSpace server running everything: Apache, Tomcat, Postgres, SOLR, Elastic Search. An incoming user request hit, makes the server's apache process shuffle it to tomcat, tomcat then has the DSpace code do some logic, which probably makes a request to the database, and by the end, the event gets logged into SOLR and Elastic Search. At each point, each service is competing for server resources and attention. So, we have changed things, and now have a separate Apache server, a separate Postgres server, a separate Elastic Search server, and we plan to sunset using SOLR in the next few months. • The apache server is now the central entry point for all of our Library webapps, theres several dozen things running through it, and all it does is hand off requests more or less. • The postgres server, is currently also sitting on the same server as our MySQL server (for LAMP apps), and its running fine enough. We have configured our production-dspace and staging-dspace to use our centralized postgres server to do all the postgres stuff. • We've pulled Elastic Search off of our dspace server, and that actually made the most performance improvement (you probably don't use elastic search statistics, so dont worry about that one). I don't think we have cold hard data of how beneficial this was, but, there's much less on-call 2am issues to respond to. Each server is siloed, and does one thing. When a request comes in, each server does what it needs to, and finishes, not holding things open, waiting for resources to free up, then getting back to it. We've been making tons of DSpace-code modifications to speed up certain requests (i.e. login, /submissions page, community/collection list, start a new submission - select collection step), but, I do attribute a better server architecture too. If your database ever became the bottleneck, then you would be able to clearly identify what the issue are. Disk IO, network traffic, CPU, memory, for that one box. As opposed to getting mixed signals from tomcat also running on the same box. One thing that I believe postgres does really well, but haven't used it in practice, is clustering. If you run into problems, and need to scale, you could add multiple postgres servers to form a pool, and they will distribute the work-load, automatically become replicas, and lots of magic. I think thats called Postgres-XC. Peter Dietz On Fri, May 17, 2013 at 12:42 PM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: [cid:image001.gif@01CE5575.4C87DCF0] Hello, Can anyone tell me if it’s a workable solution to put Postgres on a separate server from your Dspace application? In the past, we’ve had them on the same server, but are considering configuring
Re: [Dspace-tech] Filterable document types in DSpace
Thanks a bunch!! Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Thursday, May 16, 2013 4:45 AM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech (dspace-tech@lists.sourceforge.net) Subject: Re: [Dspace-tech] Filterable document types in DSpace Hi Sue, the supported formats are documented here (this is for 1.8 because 1.7 didn't have this in docs, but I don't believe it changed between 1.7 and 1.8): https://wiki.duraspace.org/display/DSDOC18/Transforming%20DSpace%20Content%20(MediaFilters) To sum it up, binary MS Office files are filterable (incl. Excel), but not the Office Open XML (MS Office 2007+) formats (docx, xlsx, pptx). I'm not really sure about PDF/A since you're explicitly asking about it, but I don't think it would be any worse than the generic PDF support, i.e. IMHO it's supported. rtf doesn't seem to be supported. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu/alienvault_d2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Postgres configuration with DSpace
Hello, Can anyone tell me if it's a workable solution to put Postgres on a separate server from your Dspace application? In the past, we've had them on the same server, but are considering configuring a Postgres-only server so that we don't have Postgres instances all over the place. We currently have most of our Dspace instances on Sun Solaris 10/Unix machines. If this is possible (I'm thinking it is), can anyone list pros and cons of implementing this configuration? Are they any performance issues we need to be aware of, etc? Thanks in advance, Sue - Sue Thornton Software Developer/DBA SGT, Inc. ~ LITES Contract NASA Langley Research Center 130 Research Drive, Hampton, VA. 23666 Office: (757) 224-4130 Mobile: (757) 506-9903 Fax: (757) 224-4001 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov sthorn...@sgt-inc.commailto:sthorn...@sgt-inc.com inline: image001.gif-- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu/alienvault_d2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Filterable document types in DSpace
Hello, Can someone confirm that the following bitstream types are the ONLY ones that are currently filterable as of Dspace version 1.7.1? 1. .pdf 2. .doc 3. .docx 4. .ppt 5. .pptx 6. .html Just to clarify, are the following types filterable? 1. .rtf 2. .xls 3. .xlsx 4. .pdf-a I'm trying to write a SQL query which will identify documents in our repository that could not be filtered and may be corrupt and I want to make sure I'm excluding all bitstream types that cannot be filtered in the first place. Thanks in advance, Sue - Sue Thornton Software Developer/DBA SGT, Inc. ~ LITES Contract NASA Langley Research Center 130 Research Drive, Hampton, VA. 23666 Office: (757) 224-4130 Mobile: (757) 506-9903 Fax: (757) 224-4001 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov sthorn...@sgt-inc.commailto:sthorn...@sgt-inc.com inline: image001.gif-- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu/alienvault_d2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Number of items archived each month
Thanks for the great query! Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: van Hoek, Wilko [mailto:wilko.vanh...@gesis.org] Sent: Tuesday, May 14, 2013 3:47 AM To: Thornton, Susan M. (LARC-B702)[LITES]; Sean Carte; dspace-tech Subject: AW: [Dspace-tech] Number of items archived each month Hello, I don't know whether you have already solved it, but I've put up the following query to sum up accession and availability dates of documents on a monthly basis: SELECT * FROM ((SELECT 'dc.date.accessioned' AS field, substring(text_value FROM 1 FOR 4) AS year,substring(text_value FROM 6 FOR 2) AS month, COUNT(item_id) as numberOfDocs FROM metadatavalue WHERE metadata_field_id = (SELECT metadata_field_id FROM metadatafieldregistry WHERE metadata_schema_id = 1 AND element = 'date' AND qualifier = 'accessioned') GROUP BY year, month ORDER BY year,month) UNION (SELECT 'dc.date.available' AS field, substring(text_value FROM 1 FOR 4) AS year,substring(text_value FROM 6 FOR 2) AS month, COUNT(item_id) as numberOfDocs FROM metadatavalue WHERE metadata_field_id = (SELECT metadata_field_id FROM metadatafieldregistry WHERE metadata_schema_id = 1 AND element = 'date' AND qualifier = 'available') GROUP BY year, month ORDER BY year,month)) AS accessAvail ORDER BY field, year, month Maybe this is helpful to someone! Wilko Von: Thornton, Susan M. (LARC-B702)[LITES] [mailto:susan.m.thorn...@nasa.gov] Gesendet: Montag, 13. Mai 2013 20:27 An: Sean Carte; dspace-tech Betreff: Re: [Dspace-tech] Number of items archived each month You will have to join the Item table to the metadatavalue table where metadata_field_id = 99 (where 99 = date.accessioned). Do your date specification on date.accessioned since that's the date/timestamp the Item was added to the repository. Good luck, Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: Sean Carte [mailto:sean.ca...@gmail.com] Sent: Monday, May 06, 2013 5:57 AM To: dspace-tech Subject: [Dspace-tech] Number of items archived each month Is it possible to get a count of the number of items archived in a particular month? I've been using the following: SELECT COUNT(*) FROM item WHERE last_modified = '2013-04-01 00:00:00' AND last_modified '2013-05-01 00:00:00' AND owning_collection = 22; ... but I don't think this is giving me what I need. Presumably 'last_modified' gets updated whenever anything happens to an item. Where does the issue date of the record live? Sean -- -- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu/alienvault_d2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Number of items archived each month
Here's the query I used to provide monthly counts of Items added to our repository in April of 2013, grouped by Community, Collection, and -mm (from the date.accessioned metadata field). You can adjust the date range, grouping, and sort order to what you need. Also, this query only lists Items that are active in the repository (not deleted or withdrawn): SELECT cm.name AS community_name , co.name AS collection_name , substring(mv.text_value,1,7) AS year_month , count(*) AS num_items_added FROM metadatavalue mv , item it , collection co , community cm , community2collection c2c WHERE mv.item_id = it.item_id AND it.owning_collection = co.collection_id AND co.collection_id = c2c.collection_id AND c2c.community_id = cm.community_id AND mv.metadata_field_id = 11 /* date.accessioned */ AND it.in_archive /* Make sure the Item has not been deleted or withdrawn */ AND text_value = '2013-04' AND text_value '2013-05' /* specify the starting date here in format -mm */ GROUP BY 1, 2, 3 ORDER BY 1, 2; I run the query in PGAdminIII, export the output into a .csv file, and import it into Excel where I make it pretty and distribute. :) Good luck! Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: van Hoek, Wilko [mailto:wilko.vanh...@gesis.org] Sent: Tuesday, May 14, 2013 3:47 AM To: Thornton, Susan M. (LARC-B702)[LITES]; Sean Carte; dspace-tech Subject: AW: [Dspace-tech] Number of items archived each month Hello, I don't know whether you have already solved it, but I've put up the following query to sum up accession and availability dates of documents on a monthly basis: SELECT * FROM ((SELECT 'dc.date.accessioned' AS field, substring(text_value FROM 1 FOR 4) AS year,substring(text_value FROM 6 FOR 2) AS month, COUNT(item_id) as numberOfDocs FROM metadatavalue WHERE metadata_field_id = (SELECT metadata_field_id FROM metadatafieldregistry WHERE metadata_schema_id = 1 AND element = 'date' AND qualifier = 'accessioned') GROUP BY year, month ORDER BY year,month) UNION (SELECT 'dc.date.available' AS field, substring(text_value FROM 1 FOR 4) AS year,substring(text_value FROM 6 FOR 2) AS month, COUNT(item_id) as numberOfDocs FROM metadatavalue WHERE metadata_field_id = (SELECT metadata_field_id FROM metadatafieldregistry WHERE metadata_schema_id = 1 AND element = 'date' AND qualifier = 'available') GROUP BY year, month ORDER BY year,month)) AS accessAvail ORDER BY field, year, month Maybe this is helpful to someone! Wilko Von: Thornton, Susan M. (LARC-B702)[LITES] [mailto:susan.m.thorn...@nasa.gov] Gesendet: Montag, 13. Mai 2013 20:27 An: Sean Carte; dspace-tech Betreff: Re: [Dspace-tech] Number of items archived each month You will have to join the Item table to the metadatavalue table where metadata_field_id = 99 (where 99 = date.accessioned). Do your date specification on date.accessioned since that's the date/timestamp the Item was added to the repository. Good luck, Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: Sean Carte [mailto:sean.ca...@gmail.com] Sent: Monday, May 06, 2013 5:57 AM To: dspace-tech Subject: [Dspace-tech] Number of items archived each month Is it possible to get a count of the number of items archived in a particular month? I've been using the following: SELECT COUNT(*) FROM item WHERE last_modified = '2013-04-01 00:00:00' AND last_modified '2013-05-01 00:00:00' AND owning_collection = 22; ... but I don't think this is giving me what I need. Presumably 'last_modified' gets updated whenever anything happens to an item. Where does the issue date of the record live? Sean -- -- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu/alienvault_d2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Number of items archived each month
You will have to join the Item table to the metadatavalue table where metadata_field_id = 99 (where 99 = date.accessioned). Do your date specification on date.accessioned since that's the date/timestamp the Item was added to the repository. Good luck, Sue Sue Thornton Office: (757) 224-4130 Mobile: (757) 506-9903 susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov From: Sean Carte [mailto:sean.ca...@gmail.com] Sent: Monday, May 06, 2013 5:57 AM To: dspace-tech Subject: [Dspace-tech] Number of items archived each month Is it possible to get a count of the number of items archived in a particular month? I've been using the following: SELECT COUNT(*) FROM item WHERE last_modified = '2013-04-01 00:00:00' AND last_modified '2013-05-01 00:00:00' AND owning_collection = 22; ... but I don't think this is giving me what I need. Presumably 'last_modified' gets updated whenever anything happens to an item. Where does the issue date of the record live? Sean -- -- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu/alienvault_d2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] custom embargo setter question
You've likely already checked this, but make sure your custom setter (which I'm assuming is a Java class) has a package statement in it, like: package org.dspace.embargo; Good luck! Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Shawn M. Kiewel [mailto:smkie...@gmail.com] Sent: Wednesday, May 01, 2013 2:19 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] custom embargo setter question I apologize in advance for what is likely me overlooking something brain-dead simple; I'm very new to DSpace and have inherited the application (the original developer who wrote the custom class has left). I have just upgraded my DSpace installation to 3.1 from 1.6 and have run into an issue with the embargo setter. We are using a custom setter because we wish to limit by IP as well, and this was working perfectly under 1.6. Now, however, I am getting a ClassNotFound exception when I try to add an item to the repo. I have copied the source file over to [dspace-src]/dspace-api/src/main/java/org/dspace/embargo. I did not see any errors running mvn or ant, though I may have missed them. Any ideas of where to look to hunt down why my class isn't being found? Thanks for your assistance, Shawn -- Introducing AppDynamics Lite, a free troubleshooting tool for Java/.NET Get 100% visibility into your production application - at no cost. Code-level diagnostics for performance bottlenecks with 2% overhead Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap1 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Introducing AppDynamics Lite, a free troubleshooting tool for Java/.NET Get 100% visibility into your production application - at no cost. Code-level diagnostics for performance bottlenecks with 2% overhead Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap1 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] How to import archived community and its collections in to dspace
We are running version 1.7.1 JSPUI, so you'll have to check and see if the import script changed between versions 1.7.1 and 1.8.2 JSPUI, but here is the command from our import script (**Note: this is run outside of launcher.xml): $BINDIR/dsrun org.dspace.app.itemimport.ItemImport --add --eperson=yourem...@youremail.commailto:--eperson=yourem...@youremail.com --collection=handle_of_the_collection_you're_importing_into_like_2323/105897 --source=fully_qualified_directory_where_your_source_files_reside --mapfile=fully_qualified_directory_where_your_mapfile_will_be_written.map fully_qualified_directory_where_your_outfile_from_script_will_be_written.out Hope this helps! Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: jayachandra B [mailto:jayachandra1...@gmail.com] Sent: Monday, April 29, 2013 10:16 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech Subject: Re: [Dspace-tech] How to import archived community and its collections in to dspace Can you give me that import command? On Mon, Apr 29, 2013 at 8:51 PM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: Hi, Unzip the files and use ItemImport to re-import the Items back into DSpace. The quickest and easiest way to recreate your Communities and Collections is via the online interface. Good luck! Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: jayachandra B [mailto:jayachandra1...@gmail.commailto:jayachandra1...@gmail.com] Sent: Monday, April 29, 2013 10:28 AM To: dspace-tech Subject: [Dspace-tech] How to import archived community and its collections in to dspace Hi, I am using dpsace 1.8.2 jspui. I have exported some community and its collections. Later I have deleted that community and its collections. I have the exported zip folder of the deleted community. Now how can i import that community in to my dspace. -- Regards Jayachandra -- Regards Jayachandra -- Introducing AppDynamics Lite, a free troubleshooting tool for Java/.NET Get 100% visibility into your production application - at no cost. Code-level diagnostics for performance bottlenecks with 2% overhead Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap1___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] While importing collections it is asking map file must be specified
The map file is an OUTPUT file that is created when you do a DSpace import. It will contain a number (normally an integer beginning with 1 and incrementing with each imported record) and the handle that was assigned to the new Item in your repository. It can either be saved as a record of the Items that were imported in that batch, or it can be used as input to a delete of that batch of Items (using ItemImport) if something is wrong with the imported records and they have to be deleted. The format of the file is: Number Handle 1 handle-prefix/handle_id Example: Let's say you imported 3 records in your batch. Here's what your map file might look like after a successful import of the three items: 1 2042/347989 2 2042/347990 3 2042/347991 Hope this helps! Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: jayachandra B [mailto:jayachandra1...@gmail.com] Sent: Saturday, April 27, 2013 1:01 PM To: dspace-tech Subject: [Dspace-tech] While importing collections it is asking map file must be specified Hi, I am using dspace 1.8.2 when I am importing collection it is asking map file must be specified . Can any one tell what is map file how to specify it -- Regards Jayachandra -- Try New Relic Now We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] How to import archived community and its collections in to dspace
Hi, Unzip the files and use ItemImport to re-import the Items back into DSpace. The quickest and easiest way to recreate your Communities and Collections is via the online interface. Good luck! Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: jayachandra B [mailto:jayachandra1...@gmail.com] Sent: Monday, April 29, 2013 10:28 AM To: dspace-tech Subject: [Dspace-tech] How to import archived community and its collections in to dspace Hi, I am using dpsace 1.8.2 jspui. I have exported some community and its collections. Later I have deleted that community and its collections. I have the exported zip folder of the deleted community. Now how can i import that community in to my dspace. -- Regards Jayachandra -- Try New Relic Now We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Statistics in DSpace from version 1.7 -- 1.8 -- 3.0
Hi, Can someone tell me if the Statistics package in DSpace has changed from version 1.7 (integration with SOLR) to 1.8 and 3.0, or is it basically the same? Thanks in advance. Best regards, Sue Walker-Thornton Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Try New Relic Now We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] how to change DSpace logo to my Institute logo and name in header.default.jsp
Did you make your change in your-source-directory/dspace/modules/jspui/src/main/webapp/layout/header-default.jsp before you did mvn and ant commands? (Make sure it's header-default.jsp, not header.default.jsp.) If so, look at dspace-implementation-directory/webapps/jspui/layout/header-default.jsp and make sure it has your changes. If not, make sure everything above is correct, try mvn clean package and then the ant command, then restart your web server. If you still don't see your changes, trying clearing your cache, or exiting and restarting your browser. Hope this works! Best regards, Sue Walker-Thornton Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: pankaj nagah [mailto:nagah.pan...@gmail.com] Sent: Wednesday, April 17, 2013 10:21 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] how to change DSpace logo to my Institute logo and name in header.default.jsp Sir, i installed DSpace 1.7.0 . i did all possible efforts for change the dspace logo to our institute logo , but till now i am unable to change it. i did these changes which are given below. td a href=%= request.getContextPath() %/a href=http://your.dspace.website.com;img src=%= request.getContextPath() %/image/iit-logo.jpg alt=fmt:message key=jsp.layout.header-default.alt/ width=102 height=100 border=0//a/a /td td class=tagLine width=99% %-- Make as wide as possible. cellpadding repeated for broken NS 4.x --% h1 align=centerDspace at IIT ROPAR/h1 /td after that * Rebuild the DSpace installation package by running the following command from your [dspace-source]/dspace/ directory: mvn package * Re-install the DSpace WAR(s) to [dspace]/webapps by running the following command from your [dspace-source]/dspace/target/dspace-[version].dir directory: ant -Dconfig=[dspace]/config/dspace.cfg update * Depending on your setup with Tomcat, you may also need to do the following: o Shut down Tomcat, and delete any existing [tomcat]/webapps/dspace files o Copy the new .war file(s) to the Tomcat webapps directory: o Restart Tomcat. but logo is not changed... please help me how can i change it. Regards.. Pankaj -- Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Question about Statistics
Yes, it's 1.5.2 and it uses the log files. I'll take a look. Thanks! Best regards, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: bluy...@gmail.com [mailto:bluy...@gmail.com] On Behalf Of Bram Luyten Sent: Tuesday, April 16, 2013 10:01 AM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech@lists.sourceforge.net; Dedmond, Nicole K. (LARC-B702)[LITES] Subject: Re: [Dspace-tech] Question about Statistics Hi Sue, just a piece of the puzzle here but that's better than nothing, right? From your description it looks like you are looking at the pre-DSpace 1.6 legacy stats that are generated from the DSpace log files. e.g: http://demo.dspace.org/xmlui/statistics?date=2013-3 In this report, everything in the All actions performed does not necessarily corresponds with a total number of items at the end of the month. Just by looking at the field names, I would say that Items Archived in the General overview column would be your safest bet. However, I couldn't find exactly in the code how this number is determined. That code is available here: https://github.com/DSpace/DSpace/tree/master/dspace-api/src/main/java/org/dspace/app/statistics best regards, Bram -- [http://atmire.com/images/@mire_web_2.jpg] Bram Luyten @mire 2888 Loker Avenue East, Suite 315, Carlsbad, CA. 92010 Esperantolaan 4, Heverlee 3001, Belgium www.atmire.comhttp://atmire.com/website/?q=servicesutm_source=emailfooterutm_medium=emailutm_campaign=braml On Mon, Apr 15, 2013 at 7:19 PM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: Hello, We are getting ready to implement statistics soon, likely in DSpace version 3.0 (we're getting ready to upgrade from 1.7.1 to 3.0) and I have a question. One of the numbers that our customer wants to track on a monthly basis is the number of new Items added to the repository. Another one is number of times a user actually downloads a bitstream/file from an Item page. I looked at the March, 2013 statistics on the DSpace demo site just now, and the numbers don't seem to add up. I see Items Archived, Items Created, Items Added, Items installed, and more and the numbers for each are all different. How do I capture/identify the number of NEW items loaded/imported into the site during a specific time period?? Thanks in advance, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Question about Statistics
Hello, We are getting ready to implement statistics soon, likely in DSpace version 3.0 (we're getting ready to upgrade from 1.7.1 to 3.0) and I have a question. One of the numbers that our customer wants to track on a monthly basis is the number of new Items added to the repository. Another one is number of times a user actually downloads a bitstream/file from an Item page. I looked at the March, 2013 statistics on the DSpace demo site just now, and the numbers don't seem to add up. I see Items Archived, Items Created, Items Added, Items installed, and more and the numbers for each are all different. How do I capture/identify the number of NEW items loaded/imported into the site during a specific time period?? Thanks in advance, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Delete field from DC Metadata Registry in DSpace
Sounds like you definitely have something in your metadatavalue table. Try doing a select of all records in the table and see if you have one where metadata_field_id = 5 (ours is contributor.illustrator). Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: Smith, Ina ism...@sun.ac.za [mailto:ism...@sun.ac.za] Sent: Tuesday, March 26, 2013 8:41 AM To: dspace-gene...@lists.sourceforge.net; dspace-tech@lists.sourceforge.net Subject: [Dspace-general] Delete field from DC Metadata Registry in DSpace Dear all I want to delete a metadata filed from the Dublin Core Registry from our repository. There is the option to delete a field. For some reason it isn't working. I've also tested it on a clean installation. Any advice? The error I get: org.postgresql.util.PSQLException: ERROR: update or delete on table metadatafieldregistry violates foreign key constraint metadatavalue_metadata_field_id_fkey on table metadatavalue Detail: Key (metadata_field_id)=(5) is still referenced from table metadatavalue. What kind of change do we need to make? Many, many thanks. Ina Ina Smith E-Research Repository Manager (SUNScholar) | Stellenbosch University | Private Bag X5036, 7599 | South Africa SUNScholarhttp://scholar.sun.ac.za/ | SUNJournalshttp://library.sun.ac.za/English/services/az/oa/Pages/sunjournals.aspx | SUNConferenceshttp://library.sun.ac.za/Afrikaans/services/az/oa/Pages/sunconferences.aspx | E-mail: ism...@sun.ac.zamailto:ism...@sun.ac.za | Tel: +27 21 808 9139 | Skype: smith.ina | Office hours: Mo-Fr: 08h00-16h30 E-Navorsingsbewaarplekbestuurder (SUNScholar) | Universiteit Stellenbosch | Privaatsak X5036, 7599 | Suid-Afrika SUNScholarhttp://scholar.sun.ac.za/ | SUNJournalshttp://library.sun.ac.za/English/services/az/oa/Pages/sunjournals.aspx | SUNConferenceshttp://library.sun.ac.za/Afrikaans/services/az/oa/Pages/sunconferences.aspx | E-pos: ism...@sun.ac.zamailto:ism...@sun.ac.za | Tel: +27 21 808 9139 | Skype: smith.ina | Kantoorure: Mo-Fr: 08h00-16h30 [cid:image001.jpg@01CE2A04.D1767440] E-pos vrywaringsklousule Hierdie e-pos mag vertroulike inligting bevat en mag regtens geprivilegeerd wees en is slegs bedoel vir die persoon aan wie dit geadresseer is. Indien u nie die bedoelde ontvanger is nie, word u hiermee in kennis gestel dat u hierdie dokument geensins mag gebruik, versprei of kopieer nie. Stel ook asseblief die sender onmiddellik per telefoon in kennis en vee die e-pos uit. Die Universiteit aanvaar nie aanspreeklikheid vir enige skade, verlies of uitgawe wat voortspruit uit hierdie e-pos en/of die oopmaak van enige lêers aangeheg by hierdie e-pos nie. E-mail disclaimer This e-mail may contain confidential information and may be legally privileged and is intended only for the person to whom it is addressed. If you are not the intended recipient, you are notified that you may not use, distribute or copy this document in any manner whatsoever. Kindly also notify the sender immediately by telephone, and delete the e-mail. The University does not accept liability for any damage, loss or expense arising from this e-mail and/or accessing any files attached to this e-mail. inline: image001.jpg-- Own the Future-Intelreg; Level Up Game Demo Contest 2013 Rise to greatness in Intel's independent game demo contest. Compete for recognition, cash, and the chance to get your game on Steam. $5K grand prize plus 10 genre and skill prizes. Submit your demo by 6/6/13. http://p.sf.net/sfu/intel_levelupd2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] ItemImport.java failing due to extended ASCII characters from an external repository
Hi, I am in the process of importing content from an external repository, using ItemImport.java, and it keeps failing because there is a LOT of metadata that has extended ASCII characters like Comisiâon and Genáese. What is the best way around this? If I change my xml header in the Dublin_core.xml file from encoding=utf-8 to encoding=ISO-8859-1, it can successfully parse and import the record, but I thought we were only supposed to use UTF8 in DSpace. Is there any harm in regenerating all my import files and using ISO-8859-1 instead of UTF8? Thanks in advance, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Free Next-Gen Firewall Hardware Offer Buy your Sophos next-gen firewall before the end March 2013 and get the hardware for free! Learn more. http://p.sf.net/sfu/sophos-d2d-feb___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] ItemImport.java failing due to extended ASCII characters from an external repository
Thanks a bunch Brian! I'm in the process of modifying my script that creates the import files to use ISO-8859-1! Best regards, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: Brian Freels-Stendel [mailto:bfre...@unm.edu] Sent: Thursday, February 07, 2013 3:48 PM To: Thornton, Susan M. (LARC-B702)[LITES]; dspace-tech@lists.sourceforge.net Cc: Dedmond, Nicole K. (LARC-B702)[LITES] Subject: RE: [Dspace-tech] ItemImport.java failing due to extended ASCII characters from an external repository Hi Sue, This is the only way I've found to get many of my imports to work, and they seem to work without a problem. When they get entered into the db, they're UTF-8, as far as I can tell. Values show up correctly in the interface, and are searchable. B-- From: Thornton, Susan M. (LARC-B702)[LITES] [mailto:susan.m.thorn...@nasa.gov] Sent: Thursday, February 07, 2013 1:40 PM To: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Cc: Dedmond, Nicole K. (LARC-B702)[LITES] Subject: [Dspace-tech] ItemImport.java failing due to extended ASCII characters from an external repository Hi, I am in the process of importing content from an external repository, using ItemImport.java, and it keeps failing because there is a LOT of metadata that has extended ASCII characters like Comisiâon and Genáese. What is the best way around this? If I change my xml header in the Dublin_core.xml file from encoding=utf-8 to encoding=ISO-8859-1, it can successfully parse and import the record, but I thought we were only supposed to use UTF8 in DSpace. Is there any harm in regenerating all my import files and using ISO-8859-1 instead of UTF8? Thanks in advance, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Free Next-Gen Firewall Hardware Offer Buy your Sophos next-gen firewall before the end March 2013 and get the hardware for free! Learn more. http://p.sf.net/sfu/sophos-d2d-feb___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Dspace upgradation 1.8 to 3.0 Error: log4j:WARN Please initialize the log4j system properly
We get the following 2 warning messages in our web server log every time we start or restart our web server. As a matter of fact, I just restarted our web server (we use IPlanet) and voila – there they are. Someone once explained why it was appearing and that it benign, but I can’t remember the deails - sorry. it doesn’t seem to be affecting anything, so I wouldn’t worry about these unless you are having problems writing to your dspace.log or other .log files: 17/Jan/2013:11:32:44 warning CORE3283: stderr: log4j:WARN No appenders could be found for logger (org.dspace.servicemanager.DSpaceKernelInit). 17/Jan/2013:11:32:44 warning CORE3283: stderr: log4j:WARN Please initialize the log4j system properly. Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: praba [mailto:prabu...@rediffmail.com] Sent: Thursday, January 17, 2013 9:38 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Dspace upgradation 1.8 to 3.0 Error: log4j:WARN Please initialize the log4j system properly Hi, I am testing the Dspace upgradation 1.8 to 3.0, I have done all the procedure to upgrade the version and restarted the tomcat and getting the following error, Jan 16, 2013 4:16:09 PM org.apache.coyote.http11.Http11AprProtocol init INFO: Initializing Coyote HTTP/1.1 on http-8080 Jan 16, 2013 4:16:10 PM org.apache.coyote.ajp.AjpAprProtocol init INFO: Initializing Coyote AJP/1.3 on ajp-8009 Jan 16, 2013 4:16:10 PM org.apache.catalina.startup.Catalina load INFO: Initialization processed in 992 ms Jan 16, 2013 4:16:10 PM org.apache.catalina.core.StandardService start INFO: Starting service Catalina Jan 16, 2013 4:16:10 PM org.apache.catalina.core.StandardEngine start INFO: Starting Servlet Engine: Apache Tomcat/5.5.26 Jan 16, 2013 4:16:10 PM org.apache.catalina.core.StandardHost start INFO: XML validation disabled log4j:WARN No appenders could be found for logger (org.apache.catalina.startup.TldConfig). log4j:WARN Please initialize the log4j system properly. Kindly help me to solve the problem. With Regards, P.Prabahar IIAP, Bangalore [http://sigads.rediff.com/RealMedia/ads/adstream_nx.ads/www.rediffmail.com/signatureline.htm@Middle]http://sigads.rediff.com/RealMedia/ads/click_nx.ads/www.rediffmail.com/signatureline.htm@Middle? Catch India as it happens with the Rediff News App. To download it for FREE, click herehttp://track.rediff.com/click?url=___http://www.rediff.com/newsapp___lnk=signaturenewservice=newsapp -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnmore_122712___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Queries
I actually did exactly this. I added a column to both the Community and Collection tables entitled local_display_order (I use the local prefix on any column or table I add to the database so I can easily identify them later). Then I modified Community.java and Collection.java to new the new column to order my Communities and Collections. I use PGAdminIII to update the column to the desired number/order. Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Friday, January 04, 2013 10:51 AM To: Parul dubey Cc: 'DSpace-tech@lists.sourceforge.net' Subject: Re: [Dspace-tech] Queries Hi Parul, I answered several of these questions already in a separate thread. But, here's some more specifics now that I know you are using JSPUI. On 1/4/2013 4:47 AM, Parul dubey wrote: Hi I have a query kindly provide a possible solution for the same. 1.I have some Communities as Books , Periodicals , Events , Others. The default order is showing as : */Books, Events, Others , Periodicals/* But I want the community to be displayed as: */ Books, Events, Periodicals , Others/* Unfortunately, DSpace always orders Communities alphabetically. There is no easy way to customize Community ordering. You'd have to do custom Java development to implement this -- it'd likely also involve needing to add a column to the community database table to store the order. So, this is unfortunately not something that's easy to do in DSpace. It'd be extremely complex and require a lot of custom development. The only other option I can think of is to hardcode the list of communities into the community-list.jsp and home.jsp pages. [dspace-src]/dspace-jspui/dspace-jspui-webapp/src/main/webapp/community-list.jsp [dspace-src]/dspace-jspui/dspace-jspui-webapp/src/main/webapp/home.jsp But hardcoding your list of communities would not be user friendly, as you'd have to modify those JSPs rebuild DSpace every time you wanted to add a new Community. 2.Replace the name *subject* with *Keywords* from the Button(Subject) during search. In the JSPUI, any text can be modified in the Messages.properties file. In this case, I believe the key you want to change in the Messages.properties file is this one: jsp.search.advanced.type.keyword = Subject Full instructions are here: https://wiki.duraspace.org/pages/viewpage.action?pageId=19006090 3.Can new fields be added to the search criteria.(apart from *title , author* new fields like *edition , volume* etc.) Yes, you can add new search fields to DSpace by modifying the dspace.cfg file reindexing your content. The basic instructions are here: https://wiki.duraspace.org/display/DSPACE/Modify+search+fields 4.show all the metadata fields in *Simple record* rather than clicking to the *Show Full Item Record*. And not include term *dc.* You can configure which metadata fields are displayed in the JSPUI simple record in your dspace.cfg file. The basic nstructions are here: https://wiki.duraspace.org/pages/viewpage.action?pageId=19006086 Good luck! - Tim -- Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and much more. Get web development skills now with LearnDevNow - 350+ hours of step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only -- learn more at: http://p.sf.net/sfu/learnmore_122812 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and much more. Get web development skills now with LearnDevNow - 350+ hours of step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only -- learn more at: http://p.sf.net/sfu/learnmore_122812 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Queries
Sorry, that should have been ...I modified Community.java and Collection.java to USE the new column.. Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Thornton, Susan M. (LARC-B702)[LITES] [mailto:susan.m.thorn...@nasa.gov] Sent: Friday, January 04, 2013 11:22 AM To: Tim Donohue; Parul dubey Cc: 'DSpace-tech@lists.sourceforge.net' Subject: Re: [Dspace-tech] Queries I actually did exactly this. I added a column to both the Community and Collection tables entitled local_display_order (I use the local prefix on any column or table I add to the database so I can easily identify them later). Then I modified Community.java and Collection.java to new the new column to order my Communities and Collections. I use PGAdminIII to update the column to the desired number/order. Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Friday, January 04, 2013 10:51 AM To: Parul dubey Cc: 'DSpace-tech@lists.sourceforge.net' Subject: Re: [Dspace-tech] Queries Hi Parul, I answered several of these questions already in a separate thread. But, here's some more specifics now that I know you are using JSPUI. On 1/4/2013 4:47 AM, Parul dubey wrote: Hi I have a query kindly provide a possible solution for the same. 1.I have some Communities as Books , Periodicals , Events , Others. The default order is showing as : */Books, Events, Others , Periodicals/* But I want the community to be displayed as: */ Books, Events, Periodicals , Others/* Unfortunately, DSpace always orders Communities alphabetically. There is no easy way to customize Community ordering. You'd have to do custom Java development to implement this -- it'd likely also involve needing to add a column to the community database table to store the order. So, this is unfortunately not something that's easy to do in DSpace. It'd be extremely complex and require a lot of custom development. The only other option I can think of is to hardcode the list of communities into the community-list.jsp and home.jsp pages. [dspace-src]/dspace-jspui/dspace-jspui-webapp/src/main/webapp/community-list.jsp [dspace-src]/dspace-jspui/dspace-jspui-webapp/src/main/webapp/home.jsp But hardcoding your list of communities would not be user friendly, as you'd have to modify those JSPs rebuild DSpace every time you wanted to add a new Community. 2.Replace the name *subject* with *Keywords* from the Button(Subject) during search. In the JSPUI, any text can be modified in the Messages.properties file. In this case, I believe the key you want to change in the Messages.properties file is this one: jsp.search.advanced.type.keyword = Subject Full instructions are here: https://wiki.duraspace.org/pages/viewpage.action?pageId=19006090 3.Can new fields be added to the search criteria.(apart from *title , author* new fields like *edition , volume* etc.) Yes, you can add new search fields to DSpace by modifying the dspace.cfg file reindexing your content. The basic instructions are here: https://wiki.duraspace.org/display/DSPACE/Modify+search+fields 4.show all the metadata fields in *Simple record* rather than clicking to the *Show Full Item Record*. And not include term *dc.* You can configure which metadata fields are displayed in the JSPUI simple record in your dspace.cfg file. The basic nstructions are here: https://wiki.duraspace.org/pages/viewpage.action?pageId=19006086 Good luck! - Tim -- Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and much more. Get web development skills now with LearnDevNow - 350+ hours of step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only -- learn more at: http://p.sf.net/sfu/learnmore_122812 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and much more. Get web development skills now with LearnDevNow - 350+ hours of step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only -- learn more at: http://p.sf.net/sfu/learnmore_122812 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API
Re: [Dspace-tech] Queries
Ok – will do! It’s a very simple modification! Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Friday, January 04, 2013 11:34 AM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech; Parul dubey; Tim Donohue Subject: Re: [Dspace-tech] Queries Hi Sue, why don't you create a Jira issue and share the code? It would be useful as such. And someone might create even the admin UI code. -- Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and much more. Get web development skills now with LearnDevNow - 350+ hours of step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only -- learn more at: http://p.sf.net/sfu/learnmore_122812___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] checksums
Checksums for all bitstreams are stored in the bitstream table in column checksum. Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: Alain Tschanz [mailto:atsch...@njstatelib.org] Sent: Friday, October 26, 2012 4:16 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] checksums Hello, How do I display the checksum of a bitstream in the item record? Patrons would like to have a way to compare the checksum on DSpace with the checksum generated on their own computer once they download a DSpace document. I run DSpace 1.8.2 with a customized XMLUI Reference theme. Thank you. Alain Tschanz -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_nov___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Assetstore structure question
Will do! Still working on it! Thanks, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Friday, October 26, 2012 2:07 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech Subject: Re: [Dspace-tech] Assetstore structure question Sounds right, to verify if the files are present where they should be, IOW to verify file names and location. The second step would be, as I suggested, to verify if the file contents is actually what it should be by comparing it to the checksum. But you're right with doing the name/location check first, because then you should just be able to run the [dspace]/bin/dspace checker script to check the checksums. Let us know your results and findings. Experience with disaster recovery is indispensable for all of us! Regards, ~~helix84 -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_sfd2d_oct ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Assetstore structure question
Yes, that would take a while to do since we have approximately 188,000 Items in our repository and quite a few Items have more than one bitstream. :-) I did figure out a way to compare what was in the bitstream table with what was on the file system and, luckily we are not missing any assetstore files. Thanks for your email! Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Brian Freels-Stendel [mailto:bfre...@unm.edu] Sent: Friday, October 26, 2012 2:07 PM To: heli...@centrum.sk; Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech Subject: Re: [Dspace-tech] Assetstore structure question Good afternoon, If there are files in all the right places, it might be less effort to export the entire repo and then import into a fresh instance. Maybe. I know you'uns have a lot of stuff. B-- On 10/26/2012 at 11:58 AM, in message 39919fc910d0004bbec8514947c345759b734f1...@ndjsscc07.ndc.nasa.gov, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.gov wrote: What I'm in the process of doing to validate the integrity of the restore is this: 1.List all files of type -f in the /assetstore1 directory, then load it into a temporary table with 3 columns in Postgres: a. Record_id (unique identifier) b. sub_directory (contains the 1st 6 digits of all the file names c. file_name (contains the entire file name 2.Execute a sql query that looks at all rows in the bitstream table where store_number = 1 and see if the first 6 digits match the subdirectory the file was found in, on assetstore1 and the file name matches the internal_id from the bitstream table. 3.Identify “orphan” files in /assetstore1 by reversing the “EXISTS” logic in step 2 above, to see if all the files found under /assetstore2 exist in the bitstream table. I just can’t figure out why there are so many duplicates and why there are tons of files 2 levels down from /assetstore1 that shouldn’t be there. Example: [cid:image001.jpg@01CDB382.09C1D230] In this example, the hightlighted files at the bottom of the screen shot shouldn’t be there. They’re all just 2 levels down and they should be in other directories. Here’s where I’m finding the duplicates. The highlighted files are in this incorrect subdirectory, but they’re ALSO in the correct subdirectory. I’m likely going to end up having to write a script to delete these “orphan” files. I thought maybe the DSpace cleanup script would take care of this, but it doesn’t. (SUGGESTION FOR FUTURE RELEASE!!! ☺) THANKS, Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Thursday, October 25, 2012 5:37 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech Subject: Re: [Dspace-tech] Assetstore structure question On Thu, Oct 25, 2012 at 11:02 PM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: Hi Helix, We had a hardware failure on one of our assetstore file systems recently and I'm working on verifying the restore worked properly (it didn't as I'm finding lots of duplicate files and files at depth level 3). Yes, I understand that in the bitstream table, store_number tells DSpace where to find the file and the internal_id tells DSpace 2 things: 1. which subdirectory in that store_number the file resides (according to the first 6 digits) 2. what the actual file name is What a mess! Thanks for your reply - it was as I thought it was! Sue You may be lucky (as strange as it may sound) if you're getting whole files, which would indicate that just the filesystem was corrupted, not the contents of bitstreams. It should be possible to find the right location for files. If I were you, I'd make a list of all the files (find /dspace/assetstore -type f) then look up their names in the bitstream table, then take the corresponding checksum and run md5sum on the bitstream to verify its integrity. As for locations within assetstore, if the bitstream name is correct, it's easy to find the directory by the first three numbers of bitstream filename. If bitstream filename is corrupted, it would be harder. You could make a list of all their md5 sums and then do the lookup I mentioned in reverse - find the bitstream filename by its md5 sum in the bitstream table. Good luck! Just ask if you're in doubt. Regards, ~~helix84 -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_sfd2d_oct
[Dspace-tech] Assetstore structure question
Hi, Can anyone tell me if ALL files in assetstore should reside 3 subdirectories deep? Example:Internal_id in bitstream table in DSpace = 13100772466103658339790379902112832870 Am I assured that this file resides in assetstore here? assetstore directory/13/10/07 Or is there any chance it could reside here? assetstore directory/13/10 Thanks, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_sfd2d_oct___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Assetstore structure question
Thanks for your reply Brian. That's what I thought. Best regards, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Brian Freels-Stendel [mailto:bfre...@unm.edu] Sent: Thursday, October 25, 2012 3:24 PM To: dspace-tech@lists.sourceforge.net; Thornton, Susan M. (LARC-B702)[LITES] Subject: Re: [Dspace-tech] Assetstore structure question Hi Sue, It's always under the third level, so the files should never be at /13/10. The directory can be found by looking at the first six digits of the internal_id column of the bitstream table. Hope that helps. B-- On 10/25/2012 at 1:12 PM, in message 39919fc910d0004bbec8514947c345759b734f1...@ndjsscc07.ndc.nasa.gov, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.gov wrote: Hi, Can anyone tell me if ALL files in assetstore should reside 3 subdirectories deep? Example:Internal_id in bitstream table in DSpace = 13100772466103658339790379902112832870 Am I assured that this file resides in assetstore here? assetstore directory/13/10/07 Or is there any chance it could reside here? assetstore directory/13/10 Thanks, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_sfd2d_oct ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Question about Embargo?
Hello, I've been reading the DSpace 1.7.1 documentation on the Embargo feature and I'm wondering if it's something that might work for a User requirement we have. This User needs to add multiple collections of documents to DSpace, with each collection having its own scheduled Delete/Destroy date. On the specified date, the collection would be deleted from DSpace. From what I've read about the Embargo feature, it seems like this is the opposite of what we want to do since the Embargo feature seems to allow you to add documents to DSpace that may either not be available at all until a certain date, or only available to local users (not the public) until that date. You set the date when you add the document(s) to DSpace and run a nightly cron job that changes the access restrictions on the specified date. So my question is: Can we use the Embargo feature to DISALLOW access and/or delete documents on a certain, pre-specified date? Thanks in advance, Best regards, Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Browser
Hi, This reminds me of a similar problem I'm having with an HTML page I've set our web server up to display if it detects a 403 server code (we use IPlanet). The problem is that neither the logo nor the NASA insignia, which are both images in another directory/location, display when the page is invoked. In IPlanet, I have defined the HTML page to invoke as ./dspace/webapps/jspui/error/403.html . Attached is a copy of the HTML. Can anyone help? Thanks, Sue Walker-Thornton From: Graham Triggs [grahamtri...@gmail.com] Sent: Wednesday, August 22, 2012 8:29 AM To: Webshet, Sisay (ILRI) Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Browser Try right-clicking on the element, and selecting 'Inspect element' from the menu. If you look at the CSS for #ds-header-logo, you'll see that you are using a relative path for the header image. That isn't going to work as the URL changes. G On 22 August 2012 12:41, Webshet, Sisay (ILRI) s.webs...@cgiar.org wrote: Hi All, Yellow green colours on when viewd in Chrome... and header is missing [but colour combination is normal - burgundy black - when viewed in IE and Mozilla]... Amazing! Iam using dspace 1.72 using xmlui Version. http://cgspace.cgiar.org/handle/10568/1 can someone suggest Thanks sisay -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech text/html; name="403_sample.html": Unrecognized -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] what happens to handles, once an item is expunged?
My understanding has always been that if you Withdraw an Item, the handle is not reusable, but if you Delete (Expunge) an Item, then the handle is technically available for use. Even though we don't use handle.net since all of our sites are behind our firewall, our policy has always been to never re-use a handle. Best regards, Sue Sue Walker-Thornton Software Developer|Database Administrator NASA Langley Research Center SGT, Inc.|LITES Contract 130 Research Drive Hampton, VA 23666 Office: (757) 864-2368|Fax: (757) 224-4001|Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.gov From: Tim Donohue [tdono...@duraspace.org] Sent: Tuesday, August 21, 2012 12:36 PM To: Berry, Irene (CIV) Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] what happens to handles, once an item is expunged? Hi Irene, Once a handle is assigned by DSpace, it is never reused (even if the item is expunged / deleted). The only slight exception is that if you are using the AIP Backup Restore system, DSpace will allow you to *restore* a deleted/expunged Item and also restore its old Handle (obviously this is not really 'reusing' the handle as much as just pointing it back at the newly restored item). https://wiki.duraspace.org/display/DSDOC18/AIP+Backup+and+Restore - Tim On 8/21/2012 11:26 AM, Berry, Irene (CIV) wrote: Hello – I have a question for the group -- We're trying to figure something out about what happens to handles, once an item is expunged. Is that handle then gone forever from the pool of available handles, or does the handle server consider that number available for reuse? Could it cause conflicts, if the number is reused? Thank you very much, Irene Berry -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Implementing SSO
We implemented OpenSSO with DSpace 1.5.1 and it required minimal code changes in DSpace. OpenSSO basically gets a user's information and passes it to DSpace in the http headers where you then have to extract what you want and pass it to DSpace. Hope this helps! Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: Wellaway, Ian [mailto:i.j.wella...@exeter.ac.uk] Sent: Friday, July 27, 2012 9:08 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Implementing SSO Hi, I've read the previous threads about using SSO with Dspace but wondered if anyone could point me in the right direction of how to get Dspace 1.8 to work with our OpenSSO. We'd really like the swordv2 service document to ask for SSO credentials rather than LDAP. Would I be right in saying that SWORDv2 uses authentication based on the general DSpace authentication method? It seems to. If this is the case, if we implemented SSO for DSpace then SWORD should also use this method. Any help would be great. Thanks Ian Ian Wellaway Senior System Support Development Officer - Academic Systems (Room 911) Wednesdays only Technical Developer, Open Exeter - Infrastructure Systems (Room 54) Monday - Tuesday, Thursday - Friday Exeter IT Laver Building University of Exeter EX4 4QE UK tel +44 1392 722852 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Collection Admin e-people
Hi Nancy, I believe there is a configuration parameter or parameters in dspace.cfg in 1.7 that will allow to you control if description.provenance appears in the long listing and I think it defaults to NO. Best regards, Sue p.s. This type of email should go to the dspace-tech list! ☺ Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center|LITES Contract (757) 864-2368 From: Nancy Stuart [mailto:nstu...@uvic.ca] Sent: Friday, July 20, 2012 7:37 PM To: dspace-gene...@lists.sourceforge.net Subject: [Dspace-general] Collection Admin e-people Hi, We are running DSpace 1.7 and have a group of e-people who have Collection Admin authorizations to reject or approve submissions. As a high level DSpace administrator I can see the dc.description.provenance for an item, which listed the e-person that rejected a submission and the reason. But the Collection Admin e-people cannot see this information. It is important that they be able to see that information in the Collection that they administer. Does anyone have any suggestions as to why they can’t see this information. Many thanks, Nancy Nancy Stuart ETD Collection Manager University of Victoria PO Box 1800 STN CSC Victoria BC V8W 3H5 Canada Tel: (250) 721-8242 Fax: (250) 721-8240 email: nstu...@uvic.ca -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Media filter for .zip files
Hello, Has anyone created a media filter for .zip files and, if so, would you be willing to share? :) Thanks, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Tangent: how to filter .zip files? [was Re: Media filter for .zip files]
Hi Mark, I would just like one that would unzip the file, inspect the files contained within, and then filter those (if possible) based on their mime type, then add to index. I guess it does get a bit complicated though. If an index entry points to the Item that contains the .zip file and the .zip file contains multiple files, how is the user going to know which file they got a hit/hits on? But don't we have this same issue anyway with an Item that contains multiple files since when we do a search, we get a list of Items - not a list of documents?? I suppose another possibility is the filter could unzip the file, then add all the files contained within to the Item, then add all to index. I'm interested in what others say as well. Thanks, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Mark H. Wood [mailto:mw...@iupui.edu] Sent: Thursday, July 19, 2012 1:50 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Tangent: how to filter .zip files? [was Re: Media filter for .zip files] People ask about filtering .zip files from time to time. Given that a .zip archive can contain an arbitrary number of files in an arbitrary hierarchial directory structure, of arbitrary types, with arbitrary relationships among them (including none whatever), with possibly no file distinguished in any obvious way, I'm curious: what do you think a .zip filter would do? -- Mark H. Wood, Lead System Programmer mw...@iupui.edu Asking whether markets are efficient is like asking whether people are smart. -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Multiple instances of dspace on a single server
We use Iplanet which allows you to create virtual servers in order to run more than one instance of DSpace on a single server. I don't know if you can do this with Apache or not? Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: AMJAD USMAN [mailto:amjad...@hotmail.com] Sent: Friday, July 06, 2012 7:45 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Multiple instances of dspace on a single server Hello everybody, i have deployed dspace on a server. i want to create another instance of dspace on the same server for testing and development purposes. can anybody help me in this regard? Regards amjad -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] unrestricted a collection, items still restricted.
I've had this situation occur where AFTER I've imported my documents, I've changed the permission level of the collection. Unfortunately, just changing the permission level does not propagate to the Items in your Collection. To resolve my issue, I used the Advanced/Item Wildcard Policy Admin Tool on the Administrator menu under Authorization, but I'm not sure this will work for you since you say you have mixed Items in your collection (some are restricted, some are not). In this case, you might have to use the Manage an Item's Policies option on the same menu. So we don't ever get in this situation, we group our Collections such that all Items and documents in a single collection have the same access constraints. It can get very complicated and be a maintenance nightmare to mix them. Hope this helps, Best regards, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Titus, Gene W [mailto:g.ti...@austin.utexas.edu] Sent: Tuesday, June 26, 2012 8:07 AM To: dspace-tech Subject: Re: [Dspace-tech] unrestricted a collection, items still restricted. Hi helix84, Thanks for the response. I checked with the stakeholder and unfortunately there are items in the collection that will need to remain restricted, so a global change is not an option. Back to my original question, if I know the handle of the items I want to make unrestricted (there are roughly ~200), can I use the resource_id from the handle table as my hook into the resourcepolicy table via resourcepolicy.resource_id to know which entries in the resourcepolicy table to set resourcepolicy.epersongroup_id=0. Thanks, Gene On 6/25/12 2:33 PM, helix84 heli...@centrum.sk wrote: This seems to be a frequently asked question, so I documented it here: https://wiki.duraspace.org/display/DSPACE/TechnicalFaq#TechnicalFaq-Ich ang edaccessrestrictionsonacollections%2Cbutrestrictionsdidn'tchangeonitsit ems Regards, ~~helix84 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] strange DSpace 1.7.1 log entries
I have been seeing the following frequent entries in my dspace.log file for some time now. Can someone tell me what they mean and if it's anything I need to be concerned about or do? We are running DSpace 1.7.1 JSPUI on Sun Solaris 10/Unix, PostgreSQL 8.2. 2012-06-25 12:20:55,782 INFO net.sf.ehcache.util.UpdateChecker @ New update(s) found: 2.4.7 [http://www.terracotta.org/confluence/display/release/Release+Notes+Ehcache+Core+2.4] 2012-06-25 12:20:58,198 ERROR org.dspace.kernel.DSpaceKernelManager @ WARN Failed to unregister the MBean: org.dspace:name=1a01ed7b-3f4d-4ae8-9076-8d7ac12cf14b,type=DSpaceKernel Thanks in advance, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] SOLR problem
Did you look in the dspace.log to see if you actually got some errors while running the rebuild script? I had a similar problem this morning with the cleanup script. I submitted it, waited a couple of minutes and it completed without displaying any errors or messages of any kind. Then I ran a query against the bitstream table and selected records where column deleted = true and all the records that should have been deleted were not. Turns out there was an issue with a rogue bundle_id that was causing problems and the job was actually failing. These failure messages were in the dspace.log, but NOT in the output from the script. It's just a thought! Best regards, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: helix84 [mailto:heli...@centrum.sk] Sent: Monday, June 25, 2012 5:51 AM To: revskill Cc: dspace-tech@lists.sourceforge.net; dspace-gene...@lists.sourceforge.net Subject: Re: [Dspace-tech] SOLR problem On Mon, Jun 25, 2012 at 10:36 AM, revskill revskil...@gmail.com wrote: Hi everyone. I have a question about Discovery index. When i run command dspace update-discovery-index -b to rebuild index, i don't know WHERE the discovery index will locate in. I guess it is in folder solr/search/data/index, but it is not. So the first question is WHERE the discovery index is located. [dspace]/solr/search/data/index is indeed the correct index location. Try running dspace update-discovery-index and then look at the modification date of files therein. The second problem is : Suppose i suddenly delete the SOLR folder, how can i restore ( suppose i didn't backup that SOLR folder), is there any way to regenerate the SOLR folder from the default SOLR (downloaded from source) ? That's as simple as rebuilding and redeploying DSpace and running dspace update-discovery-index. Regards, ~~helix84 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Duplicate metadata fields on export
Just a helpful hint on how to make your query much quicker and easier to type and likely more efficient (better performance)! I know we all have our ways, but it works great and is very easy to read. Here's how I would've coded the second query: Your SQL: SELECT * FROM metadatavalue,metadatafieldregistry WHERE metadatavalue.metadata_field_id = metadatafieldregistry.metadata_field_id AND element = 'identifier' AND qualifier = 'uri' AND text_lang is NULL; My SQL: Option 1: SELECT * FROM metadatavalue mv , metadatafieldregistry mr WHERE mv.metadata_field_id = mr.metadata_field_id AND mr.element = 'identifier' AND mr.qualifier = 'uri' AND mv.text_lang IS NULL; Option 2: (better) SELECT only the columns you need) FROM metadatavalue mv , metadatafieldregistry mr WHERE mv.metadata_field_id = mr.metadata_field_id AND mr.element = 'identifier' AND mr.qualifier = 'uri' AND mv.text_lang IS NULL; Option 3: (best) SELECT only the columns you need) FROM metadatavalue WHERE metadata_field_id = 25 /* identifier.uri */ AND text_lang IS NULL; Best regards, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Isaak, David C [mailto:david.c.is...@kpchr.org] Sent: Monday, June 25, 2012 5:26 PM To: 'heli...@centrum.sk' Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Duplicate metadata fields on export Problem resolved, thanks helix84. Running the query SELECT * FROM metadatavalue,metadatafieldregistry WHERE metadatavalue.metadata_field_id = metadatafieldregistry.metadata_field_id AND element = 'identifier' AND qualifier = 'uri' AND text_lang = ''; resulted in zero hits, but Running the query SELECT * FROM metadatavalue,metadatafieldregistry WHERE metadatavalue.metadata_field_id = metadatafieldregistry.metadata_field_id AND element = 'identifier' AND qualifier = 'uri' AND text_lang is NULL; came back with four hits. I looked up those item numbers in the UI and indeed there were fields where the value of the field AND the text lang were both NULL. I deleted the fields through the UI, re-exported the metadata, and the extra fields were gone. David -Original Message- From: ivan.ma...@gmail.commailto:ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Monday, June 25, 2012 12:47 PM To: Isaak, David C Cc: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Duplicate metadata fields on export On Mon, Jun 25, 2012 at 8:42 PM, Isaak, David C david.c.is...@kpchr.orgmailto:david.c.is...@kpchr.org wrote: The collection has about 3000 items in it, so I cannot use the UI BME on the whole collection, You can raise the limit (for UI) in [dspace]/config/modules/bulkedit.cfg But I would recommend you to use the command line version of BME ([dspace]/bin/dspace metadata-import) to which this limitation doesn't apply. but if I use Item Update through the CLI interface, won't the [en_US] be added automatically? I don't know, I don't use that tool much. SELECT text_lang FROM metadatavalue GROUP BY text_lang; en en_US This looks a bit weird because it shows the empty string twice, but judging from the following query I assume one of them is only how your SQL client displays NULL. SELECT count(*) FROM metadatavalue WHERE text_lang IS NULL; 25569 SELECT count(*) FROM metadatavalue WHERE text_lang = ''; 574 So you have both types. The latter is probably the xyz case. Are these numbers counting metadata fields that do not usually have language codes in text_lang such as dc.identifier.uri, dc.date.accessioned, and dc.date.available? That's correct. Here's how you would find only the values of a certain field (here dc.identifier.uri): SELECT * FROM metadatavalue,metadatafieldregistry WHERE metadatavalue.metadata_field_id = metadatafieldregistry.metadata_field_id AND element = 'identifier' AND qualifier = 'uri' AND text_lang = ''; Regards, ~~helix84 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net
Re: [Dspace-tech] SOLR problem
Sorry, but could you point me in the right direction to file a Jira issue? Thanks a bunch, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Monday, June 25, 2012 5:44 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] SOLR problem On Mon, Jun 25, 2012 at 11:26 PM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.gov wrote: Did you look in the dspace.log to see if you actually got some errors while running the rebuild script? I had a similar problem this morning with the cleanup script. I submitted it, waited a couple of minutes and it completed without displaying any errors or messages of any kind. Then I ran a query against the bitstream table and selected records where column deleted = true and all the records that should have been deleted were not. Turns out there was an issue with a rogue bundle_id that was causing problems and the job was actually failing. These failure messages were in the dspace.log, but NOT in the output from the script. Hi Sue, could you file a Jira issue with your exact situation and exact error messages? We might want to make it actually display the error messages so that people don't run into these situations. Regards, ~~helix84 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] strange DSpace 1.7.1 log entries
Unfortunately we have not upgraded to 1.8.2 yet, but I'll make a note to check when we do (it's on our long to-do list! :-) Thanks, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: helix84 [mailto:heli...@centrum.sk] Sent: Monday, June 25, 2012 1:54 PM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] strange DSpace 1.7.1 log entries On Mon, Jun 25, 2012 at 7:47 PM, Mark H. Wood mw...@iupui.edu wrote: 2012-06-25 12:20:58,198 ERROR org.dspace.kernel.DSpaceKernelManager @ WARN Failed to unregister the MBean: org.dspace:name=1a01ed7b-3f4d-4ae8-9076-8d7ac12cf14b,type=DSpaceKerne l I'm curious about that one myself, but it doesn't seem to be a big problem. If you search the list archives, you'll see it has already come up a few times, even on fresh installations. One reply was that it should have been fixed between 1.7.0 and 1.7.1, but Sue said she has 1.7.1. Sue, can you try if the problem persists in 1.8.2? Regards, ~~helix84 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Problem with Import metadata option on Admin screen in DSpace 1.7.1
Hello, We are running DSpace version 1.7.1, PostgreSQL 8.2, Sun Solaris 10 Unix and are having a problem with the metadata import feature - both online and the metadata-import script. The problem is I can't figure out how to delete or modify the existing dc.date.accessioned, dc.date.available, and dc.date.issued. Months ago we loaded some documents into our repository without any metadata. Now we are trying to update these Items with their associated metadata and everything is working great with the metadata import tool except for these 3 fields. We need to be able to run a report, by accession date, of how many records we updated with metadata each month, but I don't want to have Items that have 2 separate accession dates, which is what we end up with if we try to modify the 3 fields by including them in the .csv file we feed to the metatata-import program. I've written a SQL query that I can run after the fact that will remove the older of these 3 fields from an Item if it contains more than 1 (for instance, if a record has two accession dates - one is 01-01-2012T01:05:07Z and one is 06-12-2012T03:12:15Z - the first one is the date the Item was originally loaded and the second one is the date the metadata was updated in the Item), but wouldn't I have to run index-update or index-init afterward if I used a SQL query to update the metadatavalue table? Any help with this would be appreciated. Thanks, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with Import metadata option on Admin screen in DSpace 1.7.1
It's really strange. The 3 fields already exist in the Item record since they are added by default during an import. But when I try to modify them just like I'd modify any other metadata field like dc.contributor.author or dc.language.iso, it doesn't REPLACE the values - it ADDS a new value. Then if after the 2nd accession date, available date, and issue date have been duplicated (with the date I specify in the .csv input file) with this import, I can turn right around and feed it the following file and it will successfully blank out the new values I just added, but not the original ones added. Here's an example of the dates in the Item that already exist in DSpace: dc.date.accessioned 2009-08-04T20:22:32Z- dc.date.available 2009-08-04T20:22:32Z- dc.date.issued 2009-08-04T20:22:32Z- So I want to overwrite these values with the current date, so here's what my .csv file looks like: id^collection^dc.date.accessioned[en_US]^dc.date.available[en_US]^dc.date.issued[en_US] 316222^2121/26228^2012-06-12T18:28:21Z^2012-06-12T18:28:21Z^2012-06-12T18:28:21Z Instead of overlaying the old dates with the new ones from the .csv file, it adds 3 new fields, i.e., a new dc.date.accessioned, dc.date.available, and dc.date.issued so now here’s how my Item looks in DSpace: dc.date.accessioned 2009-08-04T20:22:32Z- dc.date.accessioned 2012-06-12T18:28:21Z- dc.date.available 2009-08-04T20:22:32Z- dc.date.available 2012-06-12T18:28:21Z- dc.date.issued 2009-08-04T20:22:32Z- dc.date.issued 2012-06-12T18:28:21Z- Now if I run the update again with the following .csv file as input: id^collection^dc.date.accessioned[en_US]^dc.date.available[en_US]^dc.date.issued[en_US] 316222^2121/26228^^^ …here’s what the Item record’s dates look like now: dc.date.accessioned 2009-08-04T20:22:32Z- dc.date.available 2009-08-04T20:22:32Z- dc.date.issued 2009-08-04T20:22:32Z- In short, we’re back to the way it looked to begin with. One more interesting thing to note is that if I now run the exact same input .csv file against the Item now, it says it has nothing to update. So how does it distinguish between the 2012-06-12 dates that it deleted just fine and the older ones that it’s now ignoring? Is it possible there’s some code someplace that says “if the field=dc.date.accessioned or dc.date.available or dc.date.issued AND its “place” in metadatavalue table = 1, DO NOT UPDATE/TOUCH these metadata fields??? I’ve looked and can’t find any anywhere. This whole thing is quite baffling to me. Thanks, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Tuesday, June 12, 2012 4:27 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Problem with Import metadata option on Admin screen in DSpace 1.7.1 Hi Sue, first, I admit I never tried to actually modify values of these fields using batch metadata editor (BME). But I just checked dc.date.accessioned, dc.date.available and dc.description.provenance on an item which was created using BME and later a metadata value of the same item was modified using BME. All fields have only a single value and have the earlier date. This is on DSpace 1.8.2, can you confirm it on a testing server? In the past, I remember I encountered multiple values of the provenance field, but it was probably in 1.6.2 and not using BME, but item importer. Just a sidenote - these values are actually ignored by BME by default _during export_. See ignore-on-export in bulkedit.cfg. I don't know what happens when you try to import them. On Tue, Jun 12, 2012 at 8:47 PM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: but wouldn’t I have to run index-update or index-init afterward if I used a SQL query to update the metadatavalue table? You have to run index-update when you add/remove a metadata value. index-init has to be run only when you add/remove a metadata field. Regards, ~~helix84 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Problem with Import metadata option on Admin screen in DSpace 1.7.1
Hey! It worked!! Now that I look, for some reason, my dc.date.accessioned, dc.date.available, and dc.date.issued do NOT have en_US showing on the long listing page next to them like most of the other fields do. Thanks so much for your help!!! That's a really easy fix for me to make in my Java program that creates the .csv file! Best regards, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Tuesday, June 12, 2012 6:48 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Problem with Import metadata option on Admin screen in DSpace 1.7.1 On Wed, Jun 13, 2012 at 12:45 AM, helix84 heli...@centrum.sk wrote: Now I have a hunch that the language qualifier has something to do with it. Try to compare what it does when [en_US] is present and when you discard it. (This has bitten me several times while editing normal fields with BME.) You see, dc.date.accessioned[en_US] and dc.date.accessioned are actually two separate metadata fields for DSpace. That may have caused what you think is a duplicity But you should be able to distinguish them in the full item view by locale code. Regards, ~~helix84 -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Media Filter Errors
If you switch from using PDFBox to XPDF, most if not all of these errors will disappear. As a bonus, your filter-media will run much, much faster too! Google DSpace AND installing XPDF, you'll find a bunch of articles on how to do this. Best of luck, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: Brett Arno [mailto:barno...@gmail.com] Sent: Wednesday, April 25, 2012 5:15 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Media Filter Errors Hello All, I'm receiving a good portion of errors when running the filter-media command and wondering if anyone can provide some insight. I'm running 1.7.2 XMLUI with Mirage on a Red Hat server. Most items in the instance give this error: ERROR filtering, skipping bitstream: Item Handle: 10829/669 Bundle Name: ORIGINAL File Size: 43066 Checksum: d302cf0378a385ff16610d63943b5368 (MD5) Asset Store: 0 java.io.IOException: No such file or directory java.io.IOException: No such file or directory at java.io.UnixFileSystem.createFileExclusively(Native Method) at java.io.File.createNewFile(File.java:900) at edu.sdsc.grid.io.local.LocalFile.createNewFile(LocalFile.java:486) at org.dspace.storage.bitstore.BitstreamStorageManager.store(BitstreamStorageManager.java:300) at org.dspace.content.Bitstream.create(Bitstream.java:205) at org.dspace.content.Bundle.createBitstream(Bundle.java:384) at org.dspace.app.mediafilter.MediaFilterManager.processBitstream(MediaFilterManager.java:760) at org.dspace.app.mediafilter.MediaFilterManager.filterBitstream(MediaFilterManager.java:561) at org.dspace.app.mediafilter.MediaFilterManager.filterItem(MediaFilterManager.java:511) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersItem(MediaFilterManager.java:479) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersAllItems(MediaFilterManager.java:414) at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:333) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) The first thing I checked was that the items files exist and can be accessed through the system and from my large test sample, they all had PDFs and all opened fine. I've tried completely rebuilding the index to see if that may help, but that didn't change the results. I've tried indexing with these commands and none of them helped: [dspace]/bin/dpsace index-update [dspace]/bin/dspace index-init [dspace]/bin/dspace index-init -r -f We are using the PDF filter that was issued with the system and not using discovery. I also noticed this error in the DSpace log: WARN org.apache.pdfbox.util.PDFStreamEngine @ java.io.IOException: Error: expected hex character and not :32 java.io.IOException: Error: expected hex character and not :32 at org.apache.fontbox.cmap.CMapParser.parseNextToken(CMapParser.java:336) at org.apache.fontbox.cmap.CMapParser.parse(CMapParser.java:139) at org.apache.pdfbox.pdmodel.font.PDFont.parseCmap(PDFont.java:556) at org.apache.pdfbox.pdmodel.font.PDFont.encode(PDFont.java:390) at org.apache.pdfbox.util.PDFStreamEngine.processEncodedText(PDFStreamEngine.java:386) at org.apache.pdfbox.util.operator.ShowText.process(ShowText.java:45) at org.apache.pdfbox.util.PDFStreamEngine.processOperator(PDFStreamEngine.java:567) at org.apache.pdfbox.util.PDFStreamEngine.processSubStream(PDFStreamEngine.java:250) at org.apache.pdfbox.util.PDFStreamEngine.processStream(PDFStreamEngine.java:208) at org.apache.pdfbox.util.PDFTextStripper.processPage(PDFTextStripper.java:378) at org.apache.pdfbox.util.PDFTextStripper.processPages(PDFTextStripper.java:302) at org.apache.pdfbox.util.PDFTextStripper.writeText(PDFTextStripper.java:258) at org.dspace.app.mediafilter.PDFFilter.getDestinationStream(PDFFilter.java:101) at org.dspace.app.mediafilter.MediaFilterManager.processBitstream(MediaFilterManager.java:737) at org.dspace.app.mediafilter.MediaFilterManager.filterBitstream(MediaFilterManager.java:561) at org.dspace.app.mediafilter.MediaFilterManager.filterItem(MediaFilterManager.java:511) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersItem(MediaFilterManager.java:479) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersAllItems(MediaFilterManager.java:414) at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:333) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at
Re: [Dspace-tech] WARN org.dspace.app.webui.util.UIUtil @ No context, the database might be down or the connection pool exhausted.
You're right. I did change several of our PostgreSQL settings and upped our Java parameters, but I don't remember specifically which settings I changed to permanently correct the issue. It will work as a workaround until you find the right parameters to change. Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: Evelio Martínez [mailto:eve...@masmedios.com] Sent: Saturday, April 14, 2012 6:20 AM To: Thornton, Susan M. (LARC-B702)[LITES]; dspace-tech@lists.sourceforge.net Subject: RE: [Dspace-tech] WARN org.dspace.app.webui.util.UIUtil @ No context, the database might be down or the connection pool exhausted. Thanks Susan but that advice does not solve any problem, it is a workaround or a pseudo-patch to the problem. Regards Evelio De: Thornton, Susan M. (LARC-B702)[LITES] [mailto:susan.m.thorn...@nasa.gov] Enviado el: viernes, 13 de abril de 2012 21:30 Para: Evelio Martínez; dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Asunto: RE: [Dspace-tech] WARN org.dspace.app.webui.util.UIUtil @ No context, the database might be down or the connection pool exhausted. Usually restarting my web server solves this problem. Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: Evelio Martínez [mailto:eve...@masmedios.com] Sent: Friday, April 13, 2012 11:05 AM To: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] WARN org.dspace.app.webui.util.UIUtil @ No context, the database might be down or the connection pool exhausted. Hello We have a DSpace instance 1.6.2 installed with 16000 items aprox and we are having a lot of warnings like the one on the email subject. WARN org.dspace.app.webui.util.UIUtil @ No context, the database might be down or the connection pool exhausted. We can find in 25 days a mean value of 2800 warning messages per day on dspace log file. I have increased some values on postgresql and DSpace but the problem continue - RHEL 5.5 6 Gb RAM - Postgresql 8.4.2 max_connections=500 - DSpace 1.6.2 db.maxconnections = 100 - Tomcat 6.0.33 JAVA_OPTS=$JAVA_OPTS -Xmx1024m -Xms256m -XX:MaxPermSize=384m - JDK 1.6.0_30 Any clue to solve the problem? Evelio Martínez Director proyectos software. CISA, CCNA Dept. de Tecnologías y Sistemas de Información C/ Garcilaso, 15-bajo 46003 Valencia Telf: 96 369 41 23 / 677 405 909 Fax: 96 369 34 39 www.masmedios.comhttp://www.masmedios.com/ [cid:image002.gif@01CD1C93.A438AB80] Este correo electrónico y, en su caso, cualquier fichero anexo al mismo, puede contener información de carácter confidencial exclusivamente dirigida a su(s) destinatario(s). De acuerdo con la LOPD, MASmedios informa de que los datos personales contenidos quedarán sometidos a un tratamiento del que aquélla es responsable. Los interesados consienten el tratamiento de sus datos para estos fines, pudiendo ejercitar sus derechos de acceso, rectificación, cancelación y oposición dirigiéndose por escrito a MASmedios para la gestión de la información, calle Garcilaso 15-B 46003 Valencia o en proteccionda...@masmedios.commailto:proteccionda...@masmedios.com inline: image001.pnginline: image002.gif-- Better than sec? Nothing is better than sec when it comes to monitoring Big Data applications. Try Boundary one-second resolution app monitoring today. Free. http://p.sf.net/sfu/Boundary-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Configuring which metadata fields display on the short listing for individual collections in XMLUI and what labels display next to them
Hi, We've just finished implementing a test version of Manakin/XMLUI in one of our test DSpace instances, but I can't find any documentation on how to configure which fields display on your short listing for each collection, or where to define the labels for each metadata field. Can someone help me out with this? I tried to do it the same way it works in JSPUI, but couldn't get it to work. Thanks in advance, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Better than sec? Nothing is better than sec when it comes to monitoring Big Data applications. Try Boundary one-second resolution app monitoring today. Free. http://p.sf.net/sfu/Boundary-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] WARN org.dspace.app.webui.util.UIUtil @ No context, the database might be down or the connection pool exhausted.
Usually restarting my web server solves this problem. Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: Evelio Martínez [mailto:eve...@masmedios.com] Sent: Friday, April 13, 2012 11:05 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] WARN org.dspace.app.webui.util.UIUtil @ No context, the database might be down or the connection pool exhausted. Hello We have a DSpace instance 1.6.2 installed with 16000 items aprox and we are having a lot of warnings like the one on the email subject. WARN org.dspace.app.webui.util.UIUtil @ No context, the database might be down or the connection pool exhausted. We can find in 25 days a mean value of 2800 warning messages per day on dspace log file. I have increased some values on postgresql and DSpace but the problem continue - RHEL 5.5 6 Gb RAM - Postgresql 8.4.2 max_connections=500 - DSpace 1.6.2 db.maxconnections = 100 - Tomcat 6.0.33 JAVA_OPTS=$JAVA_OPTS -Xmx1024m -Xms256m -XX:MaxPermSize=384m - JDK 1.6.0_30 Any clue to solve the problem? Evelio Martínez Director proyectos software. CISA, CCNA Dept. de Tecnologías y Sistemas de Información C/ Garcilaso, 15-bajo 46003 Valencia Telf: 96 369 41 23 / 677 405 909 Fax: 96 369 34 39 www.masmedios.comhttp://www.masmedios.com/ [cid:image002.gif@01CD198A.4D0BC290] Este correo electrónico y, en su caso, cualquier fichero anexo al mismo, puede contener información de carácter confidencial exclusivamente dirigida a su(s) destinatario(s). De acuerdo con la LOPD, MASmedios informa de que los datos personales contenidos quedarán sometidos a un tratamiento del que aquélla es responsable. Los interesados consienten el tratamiento de sus datos para estos fines, pudiendo ejercitar sus derechos de acceso, rectificación, cancelación y oposición dirigiéndose por escrito a MASmedios para la gestión de la información, calle Garcilaso 15-B 46003 Valencia o en proteccionda...@masmedios.commailto:proteccionda...@masmedios.com inline: image001.pnginline: image002.gif-- For Developers, A Lot Can Happen In A Second. Boundary is the first to Know...and Tell You. Monitor Your Applications in Ultra-Fine Resolution. Try it FREE! http://p.sf.net/sfu/Boundary-d2dvs2___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] changes to messages.xml did not reflect
If you edited your changes in the DSpace Source directory, you have to run the maven assemble and dspace compile (see the DSpace manual for specific instructions) prior to restarting your web server, in order to see your changes. Hope this helps, Best regards, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: Priya S [mailto:priya579...@googlemail.com] Sent: Tuesday, April 10, 2012 12:05 PM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] changes to messages.xml did not reflect Hi, I am new to dspace. I want to modify welcome message in the login page, so edited the file messages.xml under /home/usr/install/webapps/xmlui/i18n. But the changes are not getting reflected, I tried restarting tomcat deleting the cocoon cache. Can someone tell me pls. Thanks regards Priya -- Better than sec? Nothing is better than sec when it comes to monitoring Big Data applications. Try Boundary one-second resolution app monitoring today. Free. http://p.sf.net/sfu/Boundary-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Item Recommendation in DSpace ver. 1.7.1 XMLUI
Ah yes...I think you're right. It wasn't clear from the dspace.cfg file, but it's definitely not showing up in XMLUI. Thanks a bunch! Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Thursday, March 22, 2012 6:09 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Item Recommendation in DSpace ver. 1.7.1 XMLUI On Thu, Mar 22, 2012 at 20:55, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.gov wrote: Can someone tell me if the “Item Recommendation” feature in DSpace is supposed to be available in the XMLUI version of DSpace, as it is in the JSPUI version? I don’t see it in our test XMLUI instance, but it doesn’t really say it’s JSPUI only in the dspace.cfg file. Hi Sue, this is the first time I've seen this feature. From the title of this chapter, I judge it's JSPUI-only: https://wiki.duraspace.org/display/DSDOC18/Configuration#Configuration-JSPUIItemRecommendationSetting To do it for XMLUI looks like low-hanging fruit, though. I'll keep it in mind as a prospective task if I find a student to work on DSpace. Regards, ~~helix84 -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Item Recommendation in DSpace ver. 1.7.1 XMLUI
Can someone tell me if the Item Recommendation feature in DSpace is supposed to be available in the XMLUI version of DSpace, as it is in the JSPUI version? I don't see it in our test XMLUI instance, but it doesn't really say it's JSPUI only in the dspace.cfg file. Thanks, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Are PDF-A documents filterable in DSpace?
Thanks a bunch Tim! Our problem was we had Microsoft PowerPoint XML (with a capital P on the second p in Powerpoint) for both the name and the description in our bitstreamformatregistry table. Once I changed both to Microsoft Powerpoint XML, our .pptx files filtered successfully! Thanks again, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Tuesday, March 13, 2012 5:36 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech@lists.sourceforge.net; Dedmond, Nicole K. (LARC-B702)[LITES] Subject: Re: [Dspace-tech] Are PDF-A documents filterable in DSpace? Hi Sue, The format registry should have two PPT entries: PPT --- Name: Microsoft Powerpoint MimeType: application/vnd.ms-powerpoint Description: Microsoft Powerpoint Support Level: Known File Extensions: ppt PPTX Name: Microsoft Powerpoint XML MimeType: application/vnd.openxmlformats-officedocument.presentationml.presentation Description: Microsoft Powerpoint XML Support Level: Known File Extensions: pptx This information can also be found in the '[dspace]/config/registries/bitstream-formats.xml' file: https://fisheye3.atlassian.com/browse/dspace/dspace/trunk/dspace/config/registries/bitstream-formats.xml?hb=true#to142 - Tim On 3/13/2012 4:26 PM, Thornton, Susan M. (LARC-B702)[LITES] wrote: Hi Tim, Can you give me a screen shot of your definition(s) for PowerPoint in the bitstream_format_registy? Something's still not working right and I suspect it may be here. Thanks, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Tuesday, March 13, 2012 10:44 AM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net; Dedmond, Nicole K. (LARC-B702)[LITES] Subject: Re: [Dspace-tech] Are PDF-A documents filterable in DSpace? Sue, A few responses inline... On 3/13/2012 9:22 AM, Thornton, Susan M. (LARC-B702)[LITES] wrote: For Word docs: -- * The rather outdated Text-mining tools at: http://code.google.com/p/text-mining/ * Unfortunately it looks like these do NOT support docx * But, it looks like POI (used for PPTs, see below) does work for docx. Unfortunately, this is not enabled/built out in DSpace yet. I just created an issue for it at: https://jira.duraspace.org/browse/DS-1140 *Great! Can you let us know when it's been successfully implemented?* You are welcome to subscribe to the JIRA ticket itself to receive updates. Just login to JIRA (uses the same acct as the DSpace wiki), and click Watch icon in the far right. You'll then get an email any time that ticket is updated. https://jira.duraspace.org/browse/DS-1140 Currently, we need to locate a volunteer developer to take on this work. So, I'm not sure how long it will take before it is implemented. For PPT: * POI 3.6: http://poi.apache.org/ * This software supports pptx as well *How would I integrate this with DSpace version 1.7.1 to tell DSpace to use POI to filter .pptx files?* This PPT/PPTX Filter was first made available in DSpace 1.7.0. So, it should already work in your DSpace 1.7.1 installation. In your dspace.cfg you'd just want to make sure the following is setup (it should be by default): 'filter.plugins' setting: make sure this includes PowerPoint Text Extractor, like displayed here: https://fisheye3.atlassian.com/browse/dspace/dspace/trunk/dspace/config/dspace.cfg?hb=true#to400 'FormatFilter' setting: make sure it *defines* a PowerPoint Text Extractor, like displayed here: https://fisheye3.atlassian.com/browse/dspace/dspace/trunk/dspace/config/dspace.cfg?hb=true#to411 Finally, make sure the PowerPoint Text Extractor is setup to take in two input formats: Microsoft Powerpoint, Microsoft Powerpoint XML, like displayed here: https://fisheye3.atlassian.com/browse/dspace/dspace/trunk/dspace/config/dspace.cfg?hb=true#to419 You'll then need to make sure your Bitstream Format Registry has a definition for Microsoft Powerpoint XML (pptx). Again, assuming you are running on an out-of-the-box 1.7.x, all of the above settings should be enabled by default. So, it should just work. - Tim -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Shared Manakin themes?
Great! Thanks a bunch Tim for the info! Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Monday, March 12, 2012 3:37 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech@lists.sourceforge.net; Dedmond, Nicole K. (LARC-B702)[LITES]; Costulis, Kay (LARC-B702) Subject: Re: [Dspace-tech] Shared Manakin themes? Sue, I know some folks are starting to share Themes up on GitHub. Ohio State has a few posted up at: https://github.com/osulibraries/xmlui-webapp/tree/master/themes SUNScholar has a few posted up at: https://github.com/SUNScholar/xmlui-webapp/tree/master/themes Just last week, the DSpace Developers voted that we will be working to migrate the DSpace codebase from SVN to GitHub (it's in process right now). We are hopeful that moving to GitHub will allow for more sharing of custom themes, code, etc. So, currently there is no centralized shared repository of Manakin Themes. But, once the DSpace codebase is over on GitHub, we hope to provide hints/tips on how everyone (who wants to) can start to share their themes/code via GitHub. - Tim On 3/12/2012 12:08 PM, Thornton, Susan M. (LARC-B702)[LITES] wrote: Does anyone know if there is a repository of shared Manakin user themes? I had thought there was one somewhere, but have not been able to locate it. Thanks in advance, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Shared Manakin themes?
Thanks Peter! This is very helpful. Best regards, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: Peter Dietz [mailto:pdiet...@gmail.com] Sent: Tuesday, March 13, 2012 3:57 PM To: Hilton Gibson Cc: Tim Donohue; dspace-tech@lists.sourceforge.net; Dedmond, Nicole K. (LARC-B702)[LITES]; Thornton, Susan M. (LARC-B702)[LITES]; Costulis, Kay (LARC-B702) Subject: Re: [Dspace-tech] Shared Manakin themes? Hi All, With DSpace as a whole adopting GitHub, I'm pleased to announce that The Knowledge Bank team at The Ohio State University have pushed our DSpace repository to GitHub as public fork. We look forward to sharing our contributions with others, and seeing some use, feedback, and improvements made to the work we've started so that we can improve DSpace overall. I've just created a wiki page describing a bunch of unique things we're doing with our XMLUI themes (with plenty of screenshots). Check that out at: https://github.com/osulibraries/DSpaceOSUKB/wiki/XMLUI-Customizations-to-Themes Our GitHub DSpace repository for the OSU Knowledge Bank can be found at: https://github.com/osulibraries/DSpaceOSUKB And you can find our XMLUI themes available at: https://github.com/osulibraries/DSpaceOSUKB/tree/kb-source-sandbox/dspace-xmlui/dspace-xmlui-webapp/src/main/webapp/themes I wanted to give a shoutout to the excellent people at Ohio State that have helped to develop XMLUI themes, and to help us get our code live on GitHub. Beth Black, Beth Warner, Maureen Walsh, Melanie Schlosser, Brian Stamper, Jim Muir, Ryan McGowan P.S. Our osulibraries/xmlui-themes repository is old and unmaintained. Peter Dietz On Mon, Mar 12, 2012 at 4:16 PM, Hilton Gibson hilton.gib...@gmail.commailto:hilton.gib...@gmail.com wrote: Hi All The SUNScholar style has been updated for DSpace version 1.7.2. See: http://web.lib.sun.ac.za/style/sunscholar/ Regards hg On 12 March 2012 21:37, Tim Donohue tdono...@duraspace.orgmailto:tdono...@duraspace.org wrote: Sue, I know some folks are starting to share Themes up on GitHub. Ohio State has a few posted up at: https://github.com/osulibraries/xmlui-webapp/tree/master/themes SUNScholar has a few posted up at: https://github.com/SUNScholar/xmlui-webapp/tree/master/themes Just last week, the DSpace Developers voted that we will be working to migrate the DSpace codebase from SVN to GitHub (it's in process right now). We are hopeful that moving to GitHub will allow for more sharing of custom themes, code, etc. So, currently there is no centralized shared repository of Manakin Themes. But, once the DSpace codebase is over on GitHub, we hope to provide hints/tips on how everyone (who wants to) can start to share their themes/code via GitHub. - Tim On 3/12/2012 12:08 PM, Thornton, Susan M. (LARC-B702)[LITES] wrote: Does anyone know if there is a repository of shared Manakin user themes? I had thought there was one somewhere, but have not been able to locate it. Thanks in advance, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov (W) 757-864-2368tel:757-864-2368 (M) 757-506-9903tel:757-506-9903 -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Hilton Gibson Systems Administrator JS Gericke Library Room 1025D Stellenbosch University Private Bag X5036 Stellenbosch 7599 South Africa Cell: +27 846 464 758tel:%2B27%20846%20464%20758 | Phone: +27 21 808 4100tel:%2B27%2021%20808%204100 -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases
Re: [Dspace-tech] Are PDF-A documents filterable in DSpace?
Hi Tim, Can you give me a screen shot of your definition(s) for PowerPoint in the bitstream_format_registy? Something's still not working right and I suspect it may be here. Thanks, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Tuesday, March 13, 2012 10:44 AM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: dspace-tech@lists.sourceforge.net; Dedmond, Nicole K. (LARC-B702)[LITES] Subject: Re: [Dspace-tech] Are PDF-A documents filterable in DSpace? Sue, A few responses inline... On 3/13/2012 9:22 AM, Thornton, Susan M. (LARC-B702)[LITES] wrote: For Word docs: -- * The rather outdated Text-mining tools at: http://code.google.com/p/text-mining/ * Unfortunately it looks like these do NOT support docx * But, it looks like POI (used for PPTs, see below) does work for docx. Unfortunately, this is not enabled/built out in DSpace yet. I just created an issue for it at: https://jira.duraspace.org/browse/DS-1140 *Great! Can you let us know when it's been successfully implemented?* You are welcome to subscribe to the JIRA ticket itself to receive updates. Just login to JIRA (uses the same acct as the DSpace wiki), and click Watch icon in the far right. You'll then get an email any time that ticket is updated. https://jira.duraspace.org/browse/DS-1140 Currently, we need to locate a volunteer developer to take on this work. So, I'm not sure how long it will take before it is implemented. For PPT: * POI 3.6: http://poi.apache.org/ * This software supports pptx as well *How would I integrate this with DSpace version 1.7.1 to tell DSpace to use POI to filter .pptx files?* This PPT/PPTX Filter was first made available in DSpace 1.7.0. So, it should already work in your DSpace 1.7.1 installation. In your dspace.cfg you'd just want to make sure the following is setup (it should be by default): 'filter.plugins' setting: make sure this includes PowerPoint Text Extractor, like displayed here: https://fisheye3.atlassian.com/browse/dspace/dspace/trunk/dspace/config/dspace.cfg?hb=true#to400 'FormatFilter' setting: make sure it *defines* a PowerPoint Text Extractor, like displayed here: https://fisheye3.atlassian.com/browse/dspace/dspace/trunk/dspace/config/dspace.cfg?hb=true#to411 Finally, make sure the PowerPoint Text Extractor is setup to take in two input formats: Microsoft Powerpoint, Microsoft Powerpoint XML, like displayed here: https://fisheye3.atlassian.com/browse/dspace/dspace/trunk/dspace/config/dspace.cfg?hb=true#to419 You'll then need to make sure your Bitstream Format Registry has a definition for Microsoft Powerpoint XML (pptx). Again, assuming you are running on an out-of-the-box 1.7.x, all of the above settings should be enabled by default. So, it should just work. - Tim -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Shared Manakin themes?
Does anyone know if there is a repository of shared Manakin user themes? I had thought there was one somewhere, but have not been able to locate it. Thanks in advance, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Moving contents of a Collection to another Collection
You could run a couple of SQL queries on your database: 1. Change the collection_id of all the items in the old Collection to the collection_id of the new collection in table collection2item 2. Change owning_collection of all the items in the old Collection to the collection_id of the new collection in table Item I believe this would do it. Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: Terry M. Owen [mailto:to...@umd.edu] Sent: Monday, March 12, 2012 10:10 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Moving contents of a Collection to another Collection We're running DSpace 1.7.2 and I want to absorb all of the items in one Collection into another Collection. Is there an easy way to move all the items from one Collection to another instead of one-by-one? After moving all of the items from one Collection, I'll eventually delete that Collection. Thanks! Terry Terry M. Owen DRUM Coordinator Digital Repository at the University of Maryland University of Maryland Libraries College Park, MD 20742-7011 301.314.1328 voice 301.405.9191 fax to...@umd.edumailto:to...@umd.edu http://drum.lib.umd.edu/ -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Locking down D-space
The OpenSSO software will not let them in if they are not preauthorized. Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: Monday, March 12, 2012 1:31 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: Anton Angelo; DSpace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Locking down D-space On Mon, Mar 12, 2012 at 18:27, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.gov wrote: We here at NASA Langley use OpenSSO authentication to restrict access to only those folks who have requested/been approved access to our secure site. We did have to make some minor code changes to the DSpace JSPUI app to implement this, but it works great. If you don't have preauthorization to the site, you get a landing page (responds to server code 404) that instructs the user how to request access. Hi Sue, how did you prevent unauthenticated users from viewing DSpace content? Regards, ~~helix84 -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Are PDF-A documents filterable in DSpace?
Hello, Does anyone know if PDF-A documents are currently filterable in DSpace (to make them full-text searchable)? If not, are there any plans for adding this in a future release of DSpace? Also, what about .docx, .xlsx, and .pptx? Thanks in advance, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Virtualization Cloud Management Using Capacity Planning Cloud computing makes use of virtualization - but cloud computing also focuses on allowing computing to be delivered as a service. http://www.accelacomm.com/jaw/sfnl/114/51521223/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Implementing SWORD in DSpace 1.7.1
Can anyone point me to some really good documentation on how to implement SWORD in DSpace 1.7.1? The documentation for 1.7.1 tells me how to set my configuration parameters in dspace.cfg for SWORD, but doesn't tell me what to do from there. Specifically, we are trying to transfer some content from Docushare to DSpace. Thanks in advance, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Internal Error after the dspace installation
Look in your dspace.log file(s) (normally in your {/dspace}/log directory,
which should give you more information about the error. Also look in your web
server log(s) as you may find some useful information in there.
Sue Walker-Thornton
(w): (757) 864-2368
(m): (757) 506-9903
From: ritika bhalla [mailto:rit.bhall...@gmail.com]
Sent: Thursday, February 23, 2012 10:34 PM
To: Henry, Matt - OPS District Computer Technician
Cc: DSpace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Internal Error after the dspace installation
hi. i could solve the issue by making an entry for the dspace database and
dspace user created in the pg_hba.conf file
Also, i wanted to ask what is the type of storage being used by dspace?
On Thu, Feb 23, 2012 at 6:41 PM, Henry, Matt - OPS District Computer Technician
matt.he...@owensboro.kyschools.usmailto:matt.he...@owensboro.kyschools.us
wrote:
I think this means that your dspace.cfg file may be setup incorrectly. Also
check your permissions on the webapps and your dspace folder.
Hope this helps,
Matt Henry
From: ritika bhalla
[mailto:rit.bhall...@gmail.commailto:rit.bhall...@gmail.com]
Sent: Thursday, February 23, 2012 3:07 AM
To: DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net
Subject: [Dspace-tech] Internal Error after the dspace installation
Hey,
I have successfully installed Dspace 1.8.1 with the pre-requisite softwares
installed and running. When i run the link. http:\\localhost:8080\jspui on
the home page i get the following error:
Internal System Error
The system has experienced an internal error. Please try to do what you were
doing again, and if the problem persists, please contact us so we can fix the
problem.--
--
Virtualization Cloud Management Using Capacity Planning
Cloud computing makes use of virtualization - but cloud computing
also focuses on allowing computing to be delivered as a service.
http://www.accelacomm.com/jaw/sfnl/114/51521223/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Full text search reindexing
Please let us know if this solves your problem as I'm really curious. Thanks! Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: Paul Go [mailto:pgo...@gmail.com] Sent: Friday, February 10, 2012 9:11 AM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: Dspace Tech list Subject: Re: [Dspace-tech] Full text search reindexing I ran index-init. I will try the cleanup script as well. Thank you. Paul Go Systems Librarian / Library Technology Manager Paul V. Galvin Library 35 West 33rd Street Chicago, IL 60616 312.567.7997 p...@iit.edumailto:p...@iit.edu On Thu, Feb 9, 2012 at 4:36 PM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: I'm not 100% sure, but try running the cleanup script. This removes bitstreams where bitstream.deleted = true. Also, did you run index-update or index-init to rebuild your indices? I always run index-init after I've done something like that, just to be safe. Best regards, Sue Sue Walker-Thornton (w): (757) 864-2368tel:%28757%29%20864-2368 (m): (757) 506-9903tel:%28757%29%20506-9903 From: Paul Go [mailto:pgo...@gmail.commailto:pgo...@gmail.com] Sent: Thursday, February 09, 2012 4:24 PM To: DSpace General Mailing List; Dspace Tech list Subject: [Dspace-tech] Full text search reindexing We have redacted some information from PDFs that are in our DSpace instance. This involved downloading, redacting, and re-ingesting the files, making sure the originals with the offending information were removed. We've done a full reindexing (with Tomcat off) but the redacted material is still showing up in a full-text search (even though the target items no longer have the information). How can we force re-index the full-text search? It was my understanding that reindexing would do the trick. Paul Go Systems Librarian / Library Technology Manager Paul V. Galvin Library 35 West 33rd Street Chicago, IL 60616 312.567.7997tel:312.567.7997 p...@iit.edumailto:p...@iit.edu -- Virtualization Cloud Management Using Capacity Planning Cloud computing makes use of virtualization - but cloud computing also focuses on allowing computing to be delivered as a service. http://www.accelacomm.com/jaw/sfnl/114/51521223/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Full text search reindexing
Yes. Also, what version of DSpace are you running? Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: Paul Go [mailto:pgo...@gmail.com] Sent: Friday, February 10, 2012 2:00 PM To: Brian Freels-Stendel Cc: Thornton, Susan M. (LARC-B702)[LITES]; DSpace General Mailing List; Dspace Tech list Subject: Re: [Dspace-tech] Full text search reindexing What would happen if I deleted all of the Extracted Text files for the items that have redacted material? Will new extracted text files be generated the next time the jobs are run? Paul Go Systems Librarian / Library Technology Manager Paul V. Galvin Library 35 West 33rd Street Chicago, IL 60616 312.567.7997 p...@iit.edumailto:p...@iit.edu On Fri, Feb 10, 2012 at 12:52 PM, Brian Freels-Stendel bfre...@unm.edumailto:bfre...@unm.edu wrote: Hi Paul, I'm going to hope that DSIndexer can do the trick. If not, though, there is still a last-resort, manual option. Signed in as an administrator, you can edit item bitstreams individually. The extracted texts will show up under the TEXT Bundle, under the name [originalFileName].txt. If your new files are named the same as the old ones were, you may see two .txt files with the same name. If so, you can either view each to see which is the bad one, or you could delete them both and re-index. B-- On 2/10/2012 at 11:41 AM, in message CAGD4+EtT=GRH+H3QX-EJEzmVh=Z=s960fkfyffujlykgaig...@mail.gmail.commailto:s960fkfyffujlykgaig...@mail.gmail.com, Paul Go pgo...@gmail.commailto:pgo...@gmail.com wrote: Sad to say, this did not solve the problem. We ran filter-media, cleanup and index-init jobs. I have not looked into running DSIndexer directly yet but that is my next option. Paul Go Systems Librarian / Library Technology Manager Paul V. Galvin Library 35 West 33rd Street Chicago, IL 60616 312.567.7997tel:312.567.7997 p...@iit.edumailto:p...@iit.edu On Fri, Feb 10, 2012 at 9:29 AM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: Please let us know if this solves your problem as I'm really curious. Thanks! Sue ** ** ** ** *Sue Walker-Thornton* *(w): (757) 864-2368tel:%28757%29%20864-2368* *(m): (757) 506-9903tel:%28757%29%20506-9903* ** ** *From:* Paul Go [mailto:pgo...@gmail.commailto:pgo...@gmail.com] *Sent:* Friday, February 10, 2012 9:11 AM *To:* Thornton, Susan M. (LARC-B702)[LITES] *Cc:* Dspace Tech list *Subject:* Re: [Dspace-tech] Full text search reindexing ** ** I ran index-init. I will try the cleanup script as well. Thank you. Paul Go Systems Librarian / Library Technology Manager Paul V. Galvin Library 35 West 33rd Street Chicago, IL 60616 312.567.7997tel:312.567.7997 p...@iit.edumailto:p...@iit.edu On Thu, Feb 9, 2012 at 4:36 PM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: I'm not 100% sure, but try running the cleanup script. This removes bitstreams where bitstream.deleted = true. Also, did you run index-update or index-init to rebuild your indices? I always run index-init after I've done something like that, just to be safe. Best regards, Sue *Sue Walker-Thornton* *(w): (757) 864-2368tel:%28757%29%20864-2368* *(m): (757) 506-9903tel:%28757%29%20506-9903* *From:* Paul Go [mailto:pgo...@gmail.commailto:pgo...@gmail.com] *Sent:* Thursday, February 09, 2012 4:24 PM *To:* DSpace General Mailing List; Dspace Tech list *Subject:* [Dspace-tech] Full text search reindexing We have redacted some information from PDFs that are in our DSpace instance. This involved downloading, redacting, and re-ingesting the files, making sure the originals with the offending information were removed. We've done a full reindexing (with Tomcat off) but the redacted material is still showing up in a full-text search (even though the target items no longer have the information). How can we force re-index the full-text search? It was my understanding that reindexing would do the trick. Paul Go Systems Librarian / Library Technology Manager Paul V. Galvin Library 35 West 33rd Street Chicago, IL 60616 312.567.7997tel:312.567.7997 p...@iit.edumailto:p...@iit.edu ** ** -- Virtualization Cloud Management Using Capacity Planning Cloud computing makes use of virtualization - but cloud computing also focuses on allowing computing to be delivered as a service. http://www.accelacomm.com/jaw/sfnl/114/51521223/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Full text search reindexing
I'm not 100% sure, but try running the cleanup script. This removes bitstreams where bitstream.deleted = true. Also, did you run index-update or index-init to rebuild your indices? I always run index-init after I've done something like that, just to be safe. Best regards, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: Paul Go [mailto:pgo...@gmail.com] Sent: Thursday, February 09, 2012 4:24 PM To: DSpace General Mailing List; Dspace Tech list Subject: [Dspace-tech] Full text search reindexing We have redacted some information from PDFs that are in our DSpace instance. This involved downloading, redacting, and re-ingesting the files, making sure the originals with the offending information were removed. We've done a full reindexing (with Tomcat off) but the redacted material is still showing up in a full-text search (even though the target items no longer have the information). How can we force re-index the full-text search? It was my understanding that reindexing would do the trick. Paul Go Systems Librarian / Library Technology Manager Paul V. Galvin Library 35 West 33rd Street Chicago, IL 60616 312.567.7997 p...@iit.edumailto:p...@iit.edu -- Virtualization Cloud Management Using Capacity Planning Cloud computing makes use of virtualization - but cloud computing also focuses on allowing computing to be delivered as a service. http://www.accelacomm.com/jaw/sfnl/114/51521223/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Blank home page in DSpace 1.7.1 XMLUI interface
Thanks. I honestly have no idea where to look or how to proceed with this since I know nothing about Cocoon. Any help would be much appreciated. Best regards, Sue Sue Walker-Thornton Software Developer|Database Administrator NASA Langley Research Center SGT, Inc.|LITES Contract 130 Research Drive Hampton, VA 23666 Office: (757) 864-2368|Fax: (757) 224-4001|Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.gov From: Brett Arno [barno...@gmail.com] Sent: Monday, February 06, 2012 7:13 PM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Blank home page in DSpace 1.7.1 XMLUI interface There is definitely an error occurring in cocoon. I'm not entirely sure how to fix it though - but maybe just pointing it out will help some of the experts. Cocoon Log: 2012-02-06 18:20:10,223 ERROR cocoon.handled - Sitemap: error when calling sub-sitemap DSpace Log: 2012-02-06 18:20:10,338 ERROR org.dspace.app.xmlui.cocoon.DSpaceCocoonServletFilter @ Serious Error Occurred Processing Request! javax.servlet.ServletException: PWC1244: Servlet execution threw an exception at org.apache.catalina.core.ApplicationFilterChain.servletService(ApplicationFilterChain.java:414) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:297) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:178) at org.dspace.app.xmlui.cocoon.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:111) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:210) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:178) at org.dspace.app.xmlui.cocoon.DSpaceCocoonServletFilter.doFilter(DSpaceCocoonServletFilter.java:246) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:210) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:178) at org.apache.cocoon.servlet.multipart.MultipartFilter.doFilter(MultipartFilter.java:131) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:210) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:178) at org.dspace.utils.servlet.DSpaceWebappServletFilter.doFilter(DSpaceWebappServletFilter.java:78) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:210) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:270) at org.apache.catalina.core.StandardContextValve.invokeInternal(StandardContextValve.java:241) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:182) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:571) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:160) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:571) at com.sun.webserver.connector.nsapi.NSAPIProcessor.process(NSAPIProcessor.java:149) at com.sun.webserver.connector.nsapi.NSAPIConnector.service(NSAPIConnector.java:995) On 2/6/12 6:56 PM, Peter Dietz wrote: Hi Susan, My initial guess is to try to append a slash to the URL. Or append a slash, and some random url stuff, to atleast get a 404. Peter Dietz On Mon, Feb 6, 2012 at 6:42 PM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: Hi, We’ve been running the JSPUI version of DSpace 1.7.1 for months now with no problems. Recently I’ve been working on trying to implement the XMLUI interface and am having big problems. The Maven build and ant/compile runs fine and my web server starts successfully, but nothing displays when I enter the site url in the browser (the page is completely blank). I’ve checked my server-log: [06/Feb/2012:18:18:05] info (17228): CORE1116: Sun Java System Web Server 7.0 B12/04/2006 10:15 [06/Feb/2012:18:18:05] info (17229): CORE5076: Using [Java HotSpot(TM) Server VM, Version 1.6.0_07] from [Sun Microsystems Inc.] [06/Feb/2012:18:18:07] info (17229): WEB0100: Loading web module in virtual server [ldr-dev-1.7.1-xmlui] at [/] [06/Feb/2012:18:18:09] warning (17229): CORE3283: stderr: log4j:WARN No appenders could be found for logger (org.apache.commons.digester.Digester). [06/Feb/2012:18:18:09] warning (17229): CORE3283: stderr: log4j:WARN Please initialize the log4j system properly. [06/Feb/2012:18:18:13] info (17229): PWC1412: WebModule[] ServletContext.log():Initializing Spring root WebApplicationContext [06/Feb/2012:18:18:17] info (17229): PWC1412: WebModule[] ServletContext.log():Apache Cocoon Spring Configurator v1.0.2 is running in mode
Re: [Dspace-tech] Blank home page in DSpace 1.7.1 XMLUI interface
Very strange. If I type our URL/garbage or our URL/garbage/, I still get a 200 despite the fact there’s no such directory. Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 From: Peter Dietz [mailto:pdiet...@gmail.com] Sent: Monday, February 06, 2012 6:57 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: DSpace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Blank home page in DSpace 1.7.1 XMLUI interface Hi Susan, My initial guess is to try to append a slash to the URL. Or append a slash, and some random url stuff, to atleast get a 404. Peter Dietz On Mon, Feb 6, 2012 at 6:42 PM, Thornton, Susan M. (LARC-B702)[LITES] susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov wrote: Hi, We’ve been running the JSPUI version of DSpace 1.7.1 for months now with no problems. Recently I’ve been working on trying to implement the XMLUI interface and am having big problems. The Maven build and ant/compile runs fine and my web server starts successfully, but nothing displays when I enter the site url in the browser (the page is completely blank). I’ve checked my server-log: [06/Feb/2012:18:18:05] info (17228): CORE1116: Sun Java System Web Server 7.0 B12/04/2006 10:15 [06/Feb/2012:18:18:05] info (17229): CORE5076: Using [Java HotSpot(TM) Server VM, Version 1.6.0_07] from [Sun Microsystems Inc.] [06/Feb/2012:18:18:07] info (17229): WEB0100: Loading web module in virtual server [ldr-dev-1.7.1-xmlui] at [/] [06/Feb/2012:18:18:09] warning (17229): CORE3283: stderr: log4j:WARN No appenders could be found for logger (org.apache.commons.digester.Digester). [06/Feb/2012:18:18:09] warning (17229): CORE3283: stderr: log4j:WARN Please initialize the log4j system properly. [06/Feb/2012:18:18:13] info (17229): PWC1412: WebModule[] ServletContext.log():Initializing Spring root WebApplicationContext [06/Feb/2012:18:18:17] info (17229): PWC1412: WebModule[] ServletContext.log():Apache Cocoon Spring Configurator v1.0.2 is running in mode 'prod'. [06/Feb/2012:18:18:20] info (17229): PWC1412: WebModule[] ServletContext.log():Cocoon: Block dispatcher was initialized successfully. [06/Feb/2012:18:18:21] info (17229): HTTP3072: http-listener-1.7.1-xmlui: http://146.165.44.232:80 ready to accept requests [06/Feb/2012:18:18:21] info (17229): CORE3274: successful server startup And access-log: 999.999.99.99 - - [06/Feb/2012:18:20:10 -0500] GET / HTTP/1.1 200 0 I don’t see any problems. I’m attaching my dspace.log and cocoon.log files (I have to say the cocoon.log file is mostly gibberish to me since we’re just starting out with XMLUI). I would appreciate any help in figuring out what’s wrong and why I can’t access our site. Thanks in advance, Sue p.s. DSpace 1.7.1, PostgreSQL 8.2, Sun Solaris 10/Sun OS 5.1 Sparc Unix, Java 1.6.0_07, Apache Maven 2.2.1 (r801777; 2009-08-06 15:16:01-0400), Sun Webserver 7/Iplanet Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov (W) 757-864-2368tel:757-864-2368 (M) 757-506-9903tel:757-506-9903 -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Trouble deleting records online in DSpace 1.7.1
Is the issue with withdrawing vs. deleting an Item primarily about not allowing its persistent identifier to be reassigned/reused? Sue Walker-Thornton Software Developer|Database Administrator NASA Langley Research Center SGT, Inc.|LITES Contract 130 Research Drive Hampton, VA 23666 Office: (757) 864-2368|Fax: (757) 224-4001|Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.gov From: Claudia Juergen [claudia.juer...@ub.tu-dortmund.de] Sent: Friday, February 03, 2012 6:00 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: DSpace-tech@lists.sourceforge.net; Dedmond, Nicole K. (LARC-B702)[LITES] Subject: Re: [Dspace-tech] Trouble deleting records online in DSpace 1.7.1 Hello Susan, good, otherwise you wouldn't have been able to to delete a collection or communitiy. This will most likely occur less frequently, allthough with regards to persistent id's deleting an item shouldn't occur too, rather withdrawing it. cu Claudia Jürgen I did go ahead and delete the other 2 constraints you mentioned, however I was able to delete a record online once I dropped just the collection2item $2 constraint. Thanks again for helping us solve this outstanding problem we've had since implementing 1.7.1! Best regards, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Claudia Juergen [mailto:claudia.juer...@ub.tu-dortmund.de] Sent: Friday, February 03, 2012 12:51 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: DSpace-tech@lists.sourceforge.net; Dedmond, Nicole K. (LARC-B702)[LITES] Subject: Re: [Dspace-tech] Trouble deleting records online in DSpace 1.7.1 Hello Susan, to be precise, there shoul have been 3 constraints referenced as $n to be deleted in: collection2item community2community community2collection as mentioned in my first post. Claudia Thanks so much Claudia! This fixed our problem!! Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Claudia Jürgen [mailto:claudia.juer...@ub.tu-dortmund.de] Sent: Friday, February 03, 2012 10:07 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Trouble deleting records online in DSpace 1.7.1 Hello Susan, no, in the case you ran into the below mentioned problem, you got to drop the nameless constraints, e.g.: ALTER TABLE collection2item DROP CONSTRAINT $2 The error you posted org.postgresql.util.PSQLException: ERROR: update or delete on table item violates foreign key constraint $2 on table collection2item Detail: Key (item_id)=(429349) is still referenced from table collection2item indicates that these constraints were not dropped. Hope that helps Claudia Jürgen Am 03.02.2012 15:52, schrieb Thornton, Susan M. (LARC-B702)[LITES]: Hi Claudia, I don't remember getting these errors when upgrading from 1.5 to 1.6, but we never really implemented 1.6 - I ran what I needed to run for database changes from 1.5 -- 1.6 -- 1.7 and implemented 1.7.1, so I may have missed it. So is this what you're saying I need to do? ALTER TABLE collection2item DROP CONSTRAINT collection2item_item_id_fkey; ALTER TABLE community2community DROP CONSTRAINT community2community_child_comm_id_fkey; ALTER TABLE community2collection DROP CONSTRAINT community2collection_collection_id_fkey; Thanks a bunch, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Claudia Jürgen [mailto:claudia.juer...@ub.tu-dortmund.de] Sent: Thursday, February 02, 2012 3:31 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Trouble deleting records online in DSpace 1.7.1 Hello Susan, while updating to 1.6 did you get some errors like that: psql:database_schema_15-16.sql:105: ERROR: constraint community2collection_collection_id_fkey of relation community2collection does not exist ALTER TABLE psql:database_schema_15-16.sql:108: ERROR: constraint community2community_child_comm_id_fkey of relation community2community does not exist ALTER TABLE psql:database_schema_15-16.sql:111: ERROR: constraint collection2item_item_id_fkey of relation collection2item does not exist If so, inspect your database and use the references for the foreign keys to delete them, e.g:: psql [YourDBName] \d [TableName] will show you the foreign keys, e.g.: \d community2collection Table public.community2collection Column | Type | Modifiers ---+-+--- id| integer | not null community_id | integer | collection_id | integer | Indexes: community2collection_pkey PRIMARY KEY, btree (id) community2collection_collection_id_idx btree (collection_id) community2collection_community_id_idx btree (community_id) Foreign-key constraints: $1 FOREIGN KEY (community_id) REFERENCES community
Re: [Dspace-tech] Trouble deleting records online in DSpace 1.7.1
Hi Claudia, I don't remember getting these errors when upgrading from 1.5 to 1.6, but we never really implemented 1.6 - I ran what I needed to run for database changes from 1.5 -- 1.6 -- 1.7 and implemented 1.7.1, so I may have missed it. So is this what you're saying I need to do? ALTER TABLE collection2item DROP CONSTRAINT collection2item_item_id_fkey; ALTER TABLE community2community DROP CONSTRAINT community2community_child_comm_id_fkey; ALTER TABLE community2collection DROP CONSTRAINT community2collection_collection_id_fkey; Thanks a bunch, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Claudia Jürgen [mailto:claudia.juer...@ub.tu-dortmund.de] Sent: Thursday, February 02, 2012 3:31 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Trouble deleting records online in DSpace 1.7.1 Hello Susan, while updating to 1.6 did you get some errors like that: psql:database_schema_15-16.sql:105: ERROR: constraint community2collection_collection_id_fkey of relation community2collection does not exist ALTER TABLE psql:database_schema_15-16.sql:108: ERROR: constraint community2community_child_comm_id_fkey of relation community2community does not exist ALTER TABLE psql:database_schema_15-16.sql:111: ERROR: constraint collection2item_item_id_fkey of relation collection2item does not exist If so, inspect your database and use the references for the foreign keys to delete them, e.g:: psql [YourDBName] \d [TableName] will show you the foreign keys, e.g.: \d community2collection Table public.community2collection Column | Type | Modifiers ---+-+--- id| integer | not null community_id | integer | collection_id | integer | Indexes: community2collection_pkey PRIMARY KEY, btree (id) community2collection_collection_id_idx btree (collection_id) community2collection_community_id_idx btree (community_id) Foreign-key constraints: $1 FOREIGN KEY (community_id) REFERENCES community(community_id) $2 FOREIGN KEY (collection_id) REFERENCES collection(collection_id) In that case you got to run: ALTER TABLE collection2item DROP CONSTRAINT $2; ALTER TABLE community2community DROP CONSTRAINT $2; ALTER TABLE community2collection DROP CONSTRAINT $2; The reason for this is: In Step 7 Update the database it can happen that not all the commands in the database_schema_15-16.sql are executed properly. The commands to drop foreign keys: ALTER TABLE collection2item DROP CONSTRAINT collection2item_item_id_fkey; ALTER TABLE community2community DROP CONSTRAINT community2community_child_comm_id_fkey; ALTER TABLE community2collection DROP CONSTRAINT community2collection_collection_id_fkey; assume that the keys got default names, whereas depending on the database version and operating system on which your instance started, they can have no names and just be counted internally. If you got no names or other names the script will skip the commands, with the above mentioned ERROR. This will lead to errors running DSpace as now 2 contraints exist and one is unable to delete items, collections etc. Hope that helps Claudia Jürgen Am 01.02.2012 20:46, schrieb Thornton, Susan M. (LARC-B702)[LITES]: Hello, After recently upgrading from DSpace 1.5.1 to 1.7.1, we are getting the following error whenever we try to delete an Item online: 2012-02-01 14:40:17,883 WARN org.dspace.app.webui.servlet.DSpaceServlet @ susan.m.thorn...@nasa.gov:session_id=B6C011F3369B678E2FB9ED4B0050:ip_addr=999.99.99.999:database_error:org.postgresql.util.PSQLException\colonmailto:susan.m.thorn...@nasa.gov:session_id=B6C011F3369B678E2FB9ED4B0050:ip_addr=999.99.99.999:database_error:org.postgresql.util.PSQLException\colon; ERROR\colon; update or delete on table item violates foreign key constraint $2 on table collection2item Detail\colon; Key (item_id)=(429349) is still referenced from table collection2item. org.postgresql.util.PSQLException: ERROR: update or delete on table item violates foreign key constraint $2 on table collection2item Detail: Key (item_id)=(429349) is still referenced from table collection2item. I found some old dspace-tech postings regarding this error and am wondering if the recommended fix is correct? Not sure how this one happened: after upgrading to dspace 1.6, we're having trouble deleting items from dspace. We get an error message explaining that 'update or delete on item violates foreign key constraint $2 on collection2item'. Describing collection2item yields: Table public.collection2item Column | Type | Modifiers ---+-+--- id| integer | not null collection_id | integer | item_id | integer | Indexes: collection2item_pkey
[Dspace-tech] Docushare-to-DSpace interface
Hello, We have a Docushare instance in which we store open, active projects. Once the projects are complete, we export the files/documents from Docushare to DSpace for archival (we are currently running the JSPUI version of DSpace 1.7.1 on a Sun Solaris server with PostgreSQL). For some time now, we've had a very piecemeal process that accomplishes this and we would like to automate it. Of course, the objective is to create the directory structure that DSpace needs in order to import content into specified collections. I'd like to hear from anyone who's done this or something like it and what your ultimate solution was. Has anyone used SWORD for this and, if so, what kind of development effort was required? Any other solutions we might be able to implement in a fairly short period of time? I hesitate to just write an interface between Docushare and DSpace when it's entirely possible that we might want to migrate content from another source (not just Docushare) in the future. We also periodically receive new collections to import in the form of a disk of documents and a spreadsheet of metadata where we use a similar, somewhat piecemeal process to match documents to metadata and convert to the required DSpace import directory structure. Any helpful suggestions/solutions would be appreciated! Thanks and Best regards, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Trouble deleting records online in DSpace 1.7.1
Thanks so much Claudia! This fixed our problem!! Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Claudia Jürgen [mailto:claudia.juer...@ub.tu-dortmund.de] Sent: Friday, February 03, 2012 10:07 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Trouble deleting records online in DSpace 1.7.1 Hello Susan, no, in the case you ran into the below mentioned problem, you got to drop the nameless constraints, e.g.: ALTER TABLE collection2item DROP CONSTRAINT $2 The error you posted org.postgresql.util.PSQLException: ERROR: update or delete on table item violates foreign key constraint $2 on table collection2item Detail: Key (item_id)=(429349) is still referenced from table collection2item indicates that these constraints were not dropped. Hope that helps Claudia Jürgen Am 03.02.2012 15:52, schrieb Thornton, Susan M. (LARC-B702)[LITES]: Hi Claudia, I don't remember getting these errors when upgrading from 1.5 to 1.6, but we never really implemented 1.6 - I ran what I needed to run for database changes from 1.5 -- 1.6 -- 1.7 and implemented 1.7.1, so I may have missed it. So is this what you're saying I need to do? ALTER TABLE collection2item DROP CONSTRAINT collection2item_item_id_fkey; ALTER TABLE community2community DROP CONSTRAINT community2community_child_comm_id_fkey; ALTER TABLE community2collection DROP CONSTRAINT community2collection_collection_id_fkey; Thanks a bunch, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Claudia Jürgen [mailto:claudia.juer...@ub.tu-dortmund.de] Sent: Thursday, February 02, 2012 3:31 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Trouble deleting records online in DSpace 1.7.1 Hello Susan, while updating to 1.6 did you get some errors like that: psql:database_schema_15-16.sql:105: ERROR: constraint community2collection_collection_id_fkey of relation community2collection does not exist ALTER TABLE psql:database_schema_15-16.sql:108: ERROR: constraint community2community_child_comm_id_fkey of relation community2community does not exist ALTER TABLE psql:database_schema_15-16.sql:111: ERROR: constraint collection2item_item_id_fkey of relation collection2item does not exist If so, inspect your database and use the references for the foreign keys to delete them, e.g:: psql [YourDBName] \d [TableName] will show you the foreign keys, e.g.: \d community2collection Table public.community2collection Column | Type | Modifiers ---+-+--- id| integer | not null community_id | integer | collection_id | integer | Indexes: community2collection_pkey PRIMARY KEY, btree (id) community2collection_collection_id_idx btree (collection_id) community2collection_community_id_idx btree (community_id) Foreign-key constraints: $1 FOREIGN KEY (community_id) REFERENCES community(community_id) $2 FOREIGN KEY (collection_id) REFERENCES collection(collection_id) In that case you got to run: ALTER TABLE collection2item DROP CONSTRAINT $2; ALTER TABLE community2community DROP CONSTRAINT $2; ALTER TABLE community2collection DROP CONSTRAINT $2; The reason for this is: In Step 7 Update the database it can happen that not all the commands in the database_schema_15-16.sql are executed properly. The commands to drop foreign keys: ALTER TABLE collection2item DROP CONSTRAINT collection2item_item_id_fkey; ALTER TABLE community2community DROP CONSTRAINT community2community_child_comm_id_fkey; ALTER TABLE community2collection DROP CONSTRAINT community2collection_collection_id_fkey; assume that the keys got default names, whereas depending on the database version and operating system on which your instance started, they can have no names and just be counted internally. If you got no names or other names the script will skip the commands, with the above mentioned ERROR. This will lead to errors running DSpace as now 2 contraints exist and one is unable to delete items, collections etc. Hope that helps Claudia Jürgen Am 01.02.2012 20:46, schrieb Thornton, Susan M. (LARC-B702)[LITES]: Hello, After recently upgrading from DSpace 1.5.1 to 1.7.1, we are getting the following error whenever we try to delete an Item online: 2012-02-01 14:40:17,883 WARN org.dspace.app.webui.servlet.DSpaceServlet @ susan.m.thorn...@nasa.gov:session_id=B6C011F3369B678E2FB9ED4B0050:ip_addr=999.99.99.999:database_error:org.postgresql.util.PSQLException\colonmailto:susan.m.thorn...@nasa.gov:session_id=B6C011F3369B678E2FB9ED4B0050:ip_addr=999.99.99.999:database_error:org.postgresql.util.PSQLException\colon; ERROR\colon; update or delete on table item violates
Re: [Dspace-tech] Trouble deleting records online in DSpace 1.7.1
I did go ahead and delete the other 2 constraints you mentioned, however I was able to delete a record online once I dropped just the collection2item $2 constraint. Thanks again for helping us solve this outstanding problem we've had since implementing 1.7.1! Best regards, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Claudia Juergen [mailto:claudia.juer...@ub.tu-dortmund.de] Sent: Friday, February 03, 2012 12:51 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: DSpace-tech@lists.sourceforge.net; Dedmond, Nicole K. (LARC-B702)[LITES] Subject: Re: [Dspace-tech] Trouble deleting records online in DSpace 1.7.1 Hello Susan, to be precise, there shoul have been 3 constraints referenced as $n to be deleted in: collection2item community2community community2collection as mentioned in my first post. Claudia Thanks so much Claudia! This fixed our problem!! Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Claudia Jürgen [mailto:claudia.juer...@ub.tu-dortmund.de] Sent: Friday, February 03, 2012 10:07 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Trouble deleting records online in DSpace 1.7.1 Hello Susan, no, in the case you ran into the below mentioned problem, you got to drop the nameless constraints, e.g.: ALTER TABLE collection2item DROP CONSTRAINT $2 The error you posted org.postgresql.util.PSQLException: ERROR: update or delete on table item violates foreign key constraint $2 on table collection2item Detail: Key (item_id)=(429349) is still referenced from table collection2item indicates that these constraints were not dropped. Hope that helps Claudia Jürgen Am 03.02.2012 15:52, schrieb Thornton, Susan M. (LARC-B702)[LITES]: Hi Claudia, I don't remember getting these errors when upgrading from 1.5 to 1.6, but we never really implemented 1.6 - I ran what I needed to run for database changes from 1.5 -- 1.6 -- 1.7 and implemented 1.7.1, so I may have missed it. So is this what you're saying I need to do? ALTER TABLE collection2item DROP CONSTRAINT collection2item_item_id_fkey; ALTER TABLE community2community DROP CONSTRAINT community2community_child_comm_id_fkey; ALTER TABLE community2collection DROP CONSTRAINT community2collection_collection_id_fkey; Thanks a bunch, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Claudia Jürgen [mailto:claudia.juer...@ub.tu-dortmund.de] Sent: Thursday, February 02, 2012 3:31 AM To: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Trouble deleting records online in DSpace 1.7.1 Hello Susan, while updating to 1.6 did you get some errors like that: psql:database_schema_15-16.sql:105: ERROR: constraint community2collection_collection_id_fkey of relation community2collection does not exist ALTER TABLE psql:database_schema_15-16.sql:108: ERROR: constraint community2community_child_comm_id_fkey of relation community2community does not exist ALTER TABLE psql:database_schema_15-16.sql:111: ERROR: constraint collection2item_item_id_fkey of relation collection2item does not exist If so, inspect your database and use the references for the foreign keys to delete them, e.g:: psql [YourDBName] \d [TableName] will show you the foreign keys, e.g.: \d community2collection Table public.community2collection Column | Type | Modifiers ---+-+--- id| integer | not null community_id | integer | collection_id | integer | Indexes: community2collection_pkey PRIMARY KEY, btree (id) community2collection_collection_id_idx btree (collection_id) community2collection_community_id_idx btree (community_id) Foreign-key constraints: $1 FOREIGN KEY (community_id) REFERENCES community(community_id) $2 FOREIGN KEY (collection_id) REFERENCES collection(collection_id) In that case you got to run: ALTER TABLE collection2item DROP CONSTRAINT $2; ALTER TABLE community2community DROP CONSTRAINT $2; ALTER TABLE community2collection DROP CONSTRAINT $2; The reason for this is: In Step 7 Update the database it can happen that not all the commands in the database_schema_15-16.sql are executed properly. The commands to drop foreign keys: ALTER TABLE collection2item DROP CONSTRAINT collection2item_item_id_fkey; ALTER TABLE community2community DROP CONSTRAINT community2community_child_comm_id_fkey; ALTER TABLE community2collection DROP CONSTRAINT community2collection_collection_id_fkey; assume that the keys got default names, whereas depending on the database version and operating system on which your instance started, they can have no names and just be counted internally. If you got no names or other
Re: [Dspace-tech] Docushare-to-DSpace interface
Thanks for your reply Claudia. I'm going to definitely look at SWORD as a solution for us! Best regards, Sue Sue Walker-Thornton (w): (757) 864-2368 (m): (757) 506-9903 -Original Message- From: Claudia Juergen [mailto:claudia.juer...@ub.tu-dortmund.de] Sent: Friday, February 03, 2012 2:45 PM To: Thornton, Susan M. (LARC-B702)[LITES] Cc: DSpace-tech@lists.sourceforge.net; Dedmond, Nicole K. (LARC-B702)[LITES] Subject: Re: [Dspace-tech] Docushare-to-DSpace interface Hello Susan, you could use Sword (http://swordapp.org/) to deposit from Docushare to DSpace or OAI-ORE to harvest from Docushare, if Docushare supports it. Hope that helps Claudia Jürgen Hello, We have a Docushare instance in which we store open, active projects. Once the projects are complete, we export the files/documents from Docushare to DSpace for archival (we are currently running the JSPUI version of DSpace 1.7.1 on a Sun Solaris server with PostgreSQL). For some time now, we've had a very piecemeal process that accomplishes this and we would like to automate it. Of course, the objective is to create the directory structure that DSpace needs in order to import content into specified collections. I'd like to hear from anyone who's done this or something like it and what your ultimate solution was. Has anyone used SWORD for this and, if so, what kind of development effort was required? Any other solutions we might be able to implement in a fairly short period of time? I hesitate to just write an interface between Docushare and DSpace when it's entirely possible that we might want to migrate content from another source (not just Docushare) in the future. We also periodically receive new collections to import in the form of a disk of documents and a spreadsheet of metadata where we use a similar, somewhat piecemeal process to match documents to metadata and convert to the required DSpace import directory structure. Any helpful suggestions/solutions would be appreciated! Thanks and Best regards, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2__ _ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech Mit freundlichen Gruessen Claudia Juergen Universitaetsbibliothek Dortmund Eldorado 0231/755-4043 https://eldorado.tu-dortmund.de/ Tel.: 0049-231-755-4043 -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] search can't sort by date issued
Thanks Peter. I've spent several hours researching this issue, especially why we have it in one DSpace instance and not another (running same versions). Although I'm not 100% sure, I suspect the issue is caused by invalid data in the date.issued field(s) in the respository. The solution for this, of course, would be to clean up the bad dates we have and then put some edits on the date fields that end up in DSpace so we do not allow bad dates to get IN our repository. But again, I'm not 100% sure of this and I won't be able to get back to looking into this for awhile. Best regards, Sue Sue Walker-Thornton Software Developer|Database Administrator NASA Langley Research Center SGT, Inc.|LITES Contract 130 Research Drive Hampton, VA 23666 Office: (757) 864-2368|Fax: (757) 224-4001|Mobile: (757) 506-9903 Email: susan.m.thorn...@nasa.gov From: Peter Dietz [pdiet...@gmail.com] Sent: Wednesday, February 01, 2012 12:29 PM To: Cristian Romanescu Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] search can't sort by date issued Hi All, I've just started digging into this as well. Its really unfortunate to only get relevance results for searches. In digging in, I've spit out the stack trace, and its telling me a few things. 1) Do we have bad metadata for dc.date.issued? -- (I've already harassed my content folks to have them review all our metadata) ;) 2) Are we doing the comparison of dates incorrectly. The error below says is the value of dateissued an INT. -- I've been reading this thread, which is very similar: http://www.gossamer-threads.com/lists/lucene/java-user/109530 2012-01-31 17tel:2012-01-31%2017:47:02,475 ERROR org.dspace.search.DSQuery @ Unable to use speficied sort option: dateissued 2012-01-31 17tel:2012-01-31%2017:47:02,475 ERROR org.dspace.search.DSQuery @ Invalid shift value in prefixCoded string (is encoded value really an INT?) 2012-01-31 17tel:2012-01-31%2017:47:02,476 ERROR org.dspace.search.DSQuery @ java.lang.NumberFormatException: Invalid shift value in prefixCoded string (is encoded value really an INT?) at org.apache.lucene.util.NumericUtils.prefixCodedToInt(NumericUtils.java:233) at org.apache.lucene.search.FieldCache$7.parseInt(FieldCache.java:237) at org.apache.lucene.search.FieldCacheImpl$IntCache.createValue(FieldCacheImpl.java:457) at org.apache.lucene.search.FieldCacheImpl$Cache.get(FieldCacheImpl.java:224) at org.apache.lucene.search.FieldCacheImpl.getInts(FieldCacheImpl.java:430) at org.apache.lucene.search.FieldCacheImpl$IntCache.createValue(FieldCacheImpl.java:447) at org.apache.lucene.search.FieldCacheImpl$Cache.get(FieldCacheImpl.java:224) at org.apache.lucene.search.FieldCacheImpl.getInts(FieldCacheImpl.java:430) at org.apache.lucene.search.FieldComparator$IntComparator.setNextReader(FieldComparator.java:332) at org.apache.lucene.search.TopFieldCollector$MultiComparatorNonScoringCollector.setNextReader(TopFieldCollector.java:435) at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:249) at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:240) at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:181) at org.apache.lucene.search.Hits.getMoreDocs(Hits.java:113) at org.apache.lucene.search.Hits.init(Hits.java:90) at org.apache.lucene.search.Searcher.search(Searcher.java:63) at org.dspace.search.DSQuery.doQuery(DSQuery.java:151) at org.dspace.search.DSQuery.doQuery(DSQuery.java:309) at org.dspace.app.xmlui.aspect.artifactbrowser.AbstractSearch.performSearch(AbstractSearch.java:438) Just for fun, I enabled Discovery on our development machines, and sorting by date issued works perfectly in a search. So, a quick-fix would be to switch to using discovery. But, none-the-less, I look forward to getting a resolution to this issue. Peter Dietz On Wed, Feb 1, 2012 at 7:15 AM, Cristian Romanescu cristian.romane...@eaudeweb.romailto:cristian.romane...@eaudeweb.ro wrote: Greetings, Have you tried to look into the lucene indexes with Luke tool? (http://www.getopt.org/luke/). We are using: search.index.13 = dc_date:dc.date.issued:date to filter by time interval and it works. But first, we had to remove the old indexes and re-create them to have correct indexing (ie rm -rf $builddir/search and run ./$builddir/bin/dspace index-init). It only worked when data inside index looks like 20120101 ... - when you look with luke tool HTH, Cristian On 02/01/2012 12:46 PM, Päivi Rosenström wrote: Any solution for this found yet ? Thanks! Päivi Re: [Dspace-tech] search can't sort by date issued From: James Bardinjbardin@bu... - 2011-10-27 19:23 On Thu, Oct 27, 2011 at 1:52 PM, Blanco, Joseblancoj@... wrote: # Browse indexes webui.browse.index.1 = title:item:title webui.browse.index.2 = author:metadata:dc.contributor.author:text webui.browse.index.3 = subject:metadata:dc.subject.*:text webui.browse.index.4 = dateissued:item:dateissued #
[Dspace-tech] Trouble deleting records online in DSpace 1.7.1
Hello, After recently upgrading from DSpace 1.5.1 to 1.7.1, we are getting the following error whenever we try to delete an Item online: 2012-02-01 14:40:17,883 WARN org.dspace.app.webui.servlet.DSpaceServlet @ susan.m.thorn...@nasa.gov:session_id=B6C011F3369B678E2FB9ED4B0050:ip_addr=999.99.99.999:database_error:org.postgresql.util.PSQLException\colon; ERROR\colon; update or delete on table item violates foreign key constraint $2 on table collection2item Detail\colon; Key (item_id)=(429349) is still referenced from table collection2item. org.postgresql.util.PSQLException: ERROR: update or delete on table item violates foreign key constraint $2 on table collection2item Detail: Key (item_id)=(429349) is still referenced from table collection2item. I found some old dspace-tech postings regarding this error and am wondering if the recommended fix is correct? Not sure how this one happened: after upgrading to dspace 1.6, we're having trouble deleting items from dspace. We get an error message explaining that 'update or delete on item violates foreign key constraint $2 on collection2item'. Describing collection2item yields: Table public.collection2item Column | Type | Modifiers ---+-+--- id| integer | not null collection_id | integer | item_id | integer | Indexes: collection2item_pkey PRIMARY KEY, btree (id) collection2item_collection_idx btree (collection_id) collection2item_item_id_idx btree (item_id) Foreign-key constraints: $1 FOREIGN KEY (collection_id) REFERENCES collection(collection_id) $2 FOREIGN KEY (item_id) REFERENCES item(item_id) coll2item_item_fk FOREIGN KEY (item_id) REFERENCES item(item_id) DEFERRABLE I ran the database scheme update script, and it seems to have added the final, deferrable foreign key constraint; but I can't find any reference at all to the first two FKCs ($1 and $2). As far as I can tell, they aren't supposed to exist at all; I assume they're left over from some previous version of dspace, didn't get removed at some point in the past, and just never caused problems until now. Can anybody confirm that I can go ahead and drop these constraints (and similar constraints in Community2Collection? Bill Anderson Software Developer Digital Library Development Georgia Tech Library Thanks in advance! Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Deleting Subject Keywords
Index-init should only have to be run when you install DSpace or if, for some reason, your indices get corrupted. I'm still not sure why your metadata still appears in your indices after the Item's been deleted. Sounds like you may have some other problem. Sue Sue Walker-Thornton (757) 864-2368 From: Fabiana Zollo [mailto:picc...@hotmail.it] Sent: Tuesday, January 10, 2012 12:27 PM To: Thornton, Susan M. (LARC-B702)[LITES]; heli...@centrum.sk Cc: dspace-tech@lists.sourceforge.net Subject: RE: [Dspace-tech] Deleting Subject Keywords Thank you everybody! Anyway I just solved using the following command [dspace]/bin/dspace index-init and everything works well now. Fabiana From: susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov To: heli...@centrum.skmailto:heli...@centrum.sk; picc...@hotmail.itmailto:picc...@hotmail.it CC: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Date: Tue, 10 Jan 2012 10:37:48 -0600 Subject: RE: [Dspace-tech] Deleting Subject Keywords When you delete an Item via the online interface in DSpace, the search and browse indices are immediately updated and should not be found in search or browse. I've never had to run index-update. I just tested this with DSpace 1.7.1 and it works fine. Sue Sue Walker-Thornton (757) 864-2368 -Original Message- From: helix84 [mailto:heli...@centrum.sk] Sent: Monday, January 09, 2012 12:41 PM To: Fabiana Zollo Cc: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Deleting Subject Keywords On Mon, Jan 9, 2012 at 18:12, Fabiana Zollo picc...@hotmail.itmailto:picc...@hotmail.it wrote: Hi everybody, I'm having a problem related to subject keywords. I've had a try adding an item to the archive, including all its data (author, subject, etc..). Anyway, despite I've deleted it, subject keywords and author name continue to appear in the search page. Could anyone suggest to me how to remove them from the archive permanently? You should update the search browse indexes after you deposit or remove items. Actually, it's recommended to run a nightly cron job to do that: [dspace]/bin/dspace index-update Also, if you use XMLUI with Discovery, you should update the discovery index right afterwards, too: [dspace]/bin/dspace update-discovery-index Both these commands should be run while tomcat is running (i.e. you don't need to stop it). Regards, ~~helix84 -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] search can't sort by date issued
Interesting. I just looked at Items I just imported and I did NOT specify what any of these 3 fields should be in dublin_core.xml – they all got set by DSpace (version 1.7.1). It’s interesting that date.issued is the only one with a different format: DC Field Value Language dc.date.accessioned2011-12-20T18:59:53Z - dc.date.available 2011-12-20T18:59:53Z - dc.date.issued 2011-12-20 - I wonder if maybe this is the problem….? Sue Sue Walker-Thornton (757) 864-2368 From: DeVries, Joe [mailto:joe.devr...@austin.utexas.edu] Sent: Tuesday, December 20, 2011 10:42 AM To: James Bardin; Bram Luyten Cc: dspace-tech@lists.sourceforge.net; Thornton, Susan M. (LARC-B702)[LITES] Subject: RE: [Dspace-tech] search can't sort by date issued I believe I saw an issue like this a while back in 1.6.2, when issue date was missing the trailing ‘Z’. -- Joe DeVries Senior Software Engineer Digital Library Services, TDL University of Texas at Austin 512-495-4639 PCL 1.335 / S5477 From: James Bardin [mailto:jbar...@bu.edu] Sent: Tuesday, December 20, 2011 9:38 AM To: Bram Luyten Cc: dspace-tech@lists.sourceforge.netmailto:dspace-tech@lists.sourceforge.net; susan.m.thorn...@nasa.govmailto:susan.m.thorn...@nasa.gov Subject: Re: [Dspace-tech] search can't sort by date issued On Tue, Dec 20, 2011 at 8:46 AM, Bram Luyten b...@mire.bemailto:b...@mire.be wrote: My very wild guess would be that it's related to a value in date issued that breaks the creation of the index on this value. That's a very good guess! I haven't yet gotten around to building a dspace with some more debugging around the search code to see what's actually happening, but this is very plausible. Looking the our DB, there were a few non-ISO format dates, and a couple nulls. I updates the bad format dates, removed the nulls, and reindexed, but search by date issued still doesn't work. Do all the dates need to be in a more specific format? (like full ISO: 2000-01-12T12:13:14Z). Thanks, -- James Bardin jbar...@bu.edumailto:jbar...@bu.edu Systems Engineer Boston University IST -- Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] adding a cover page to a PDF file
Looks like you're missing Java class ItemUtility. Not sure if this is a
Dspace module (I don't see it in any of my Dspace 1.7.1 source directories) or
one someone else created.
Hope this helps,
Sue
Sue Walker-Thornton
(757) 864-2368
From: Nemiz, Elvi S. [mailto:esne...@seafdec.org.ph]
Sent: Monday, November 14, 2011 9:16 PM
To: SUZUKI Keiji; dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] adding a cover page to a PDF file
Dear Keiji,
Thank you for the time and for providing me with a revised CoverPage.java that
will allow us to make our resulting pdfs pdf/a compliant. However, I received
an error when rebuilding though. Below is my error message:
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.
3.2:compile (default-compile) on project cover: Compilation failure: Compilation
failure:
[ERROR] \dspace-1.7.2-src-release\dspace\modules\cover\src\main\java\jp\zuki_ebe
tsu\dspace\util\CoverPage.java:[72,33] cannot find symbol
[ERROR] symbol : class ItemUtility
[ERROR] location: package jp.zuki_ebetsu.dspace.util
[ERROR] \dspace-1.7.2-src-release\dspace\modules\cover\src\main\java\jp\zuki_ebe
tsu\dspace\util\CoverPage.java:[590,24] cannot find symbol
[ERROR] symbol : class ItemUtility
[ERROR] location: class jp.zuki_ebetsu.dspace.util.CoverPage
[ERROR] - [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e swit
ch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please rea
d the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureExc
eption
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn goals -rf :cover
Please advise if I missed something.
Sincerely,
Elvi
On Mon, Nov 7, 2011 at 2:12 PM, SUZUKI Keiji
z...@mbc.ocn.ne.jpmailto:z...@mbc.ocn.ne.jp wrote:
Hi Elvi,
My question is can we turn
this off on some of our collections or communities?
By the way, all of our
pdfs are pdf/a compliant, is it possible to convert the resulting pdf with
cover page as pdf/a compliant?
I have implemented these functions and attached the new CoverPage.java
with this mail.
Please replace the old one with it and rebuild dspace.
There are some notes.
1) You have to place a font to embed pdf to
DSPACE-SRC/dspace/modules/cover/main/src/resources
and set this path in coverpage.font.embed parameter in dspace.cfg
2) The config parameters are changed somewhat. I place it last in this mail.
3) When I open the resulting pdf with Adobe Reader, it seems as PDF/A
but I am not sure if the resulting
pdf conforms all of the PDF/A conditions.
New config parameters which are set in DSPACE/config/dspace.cfg
=== from this ==
# for Cover Pagecoverpage.header = ABC University Repository
coverpage.footer = http://dspace.abc.educoverpage.logo =
${dspace.dir}/webapps/jspui/image/header_logo.jpgcoverpage.logo2 =
# Whether copy security parameters from original
pdfcoverpage.copysecurity = false
# owner password of the original pdf (Required if the original pdf has
the owner password)
coverpage.ownerpass =
# Default data fonts# Default sans font: use Helvetica unless this
property is not specifiedcoverpage.font.sans =
HeiseiKakuGo-W5,UniJIS-UCS2-H# Default serif font: use Times Roman
unless this property is not specifiedcoverpage.font.serif =
HeiseiMin-W3,UniJIS-UCS2-H
# Where original pdf is PDF/A (Only PDF/A-1B is supporte)? (Default
is false)coverpage.pdfa = true# Set the embed font file # Require if
coverpage.pdfa = true
# Format: font path (relative path to
DSPACE-SRC/dspace/modules/cover/src/main/resources)
# + comma + encodingcoverpage.font.embed =
fonts/ipaexg.ttf,Identity-H
# Set the CJK fonts: format is Font Name+comma+Encoding Name
(OPTIONLAL)# Japanesecoverpage.font.cjk.ja =
HeiseiMin-W3,UniJIS-UCS2-H# Traditional
Chinesecoverpage.font.cjk.zh_tw = MSung-Light,UniCNS-UCS2-H#
Simplified Chinesecoverpage.font.cjk.zh_cn =
STSong-Light,UniGB-UCS2-H# Koreancoverpage.font.cjk.ko =
HYSMyeongJo-Medium,HYSMyeongJo-Medium
# Specify communities that are omitted to add cover page
#Format: community's handles separated with commas
(OPTIONAL)coverpage.omit.community = 10236/5
# Specify collections that are omitted to add cover page#Format:
collection's handles separated with commas (OPTIONAL)
#coverpage.omit.collection = 10236/4,10236/57
# Specify the metadata that are displayed on the cover page
# Format: Tag name + colon + metadata field namecoverpage.field.1 =
Title:dc.titlecoverpage.field.2 =
Author(s):dc.contributor.authorcoverpage.field.3 =
Citation:dc.identifier.citationcoverpage.field.4 = Issue
Date:dc.date.issuedcoverpage.field.5 =
URL:dc.identifier.uri#coverpage.field.6 = Right:dc.rights
=== until this
Hope this helps
[Dspace-tech] Faster way to assemble/compile Dspace JSPUI app
Can someone please remind me where exactly I need to make changes (to the pom.xml files I think is the only place) to shorten the time it takes to assemble and compile my DSpace application if the only module I'm testing/using right now is JSPUI? I don't need OAI, SWORD, XMLUI, LNI, or Discovery until such time as we start our Manakin implementation and it takes forever for me to do the mvn package and ant update commands since all the modules are being built. I know this has been posted before, but I can't find it. Thanks in advance, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (C) 757-506-9903 -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-novd2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] document type .docm in dspace 1.7
Does anyone know if document type .docm (Microsoft Office Word Macro-enabled Document) is filterable in Dspace 1.7? I noticed it's not defined in the Bitstream format registry and I'm wondering if anyone knows what the correct parameters would be to define it? Thanks, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (C) 757-506-9903 -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-novd2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Problem assembling DSpace 1.7.1
To DSpace-tech list: We have several instances of DSpace on different machines, mainly due to access restrictions. One that we've successfully upgraded to DSpace version 1.7.1 is behind our firewall and only accessible to folks within it. We are working on implementing another instance that is currently open to the public and subject to different firewall rules. Unfortunately on this instance we are having some problems upgrading from version 1.5.1 that may or not be related: 1. I can connect to the server via port 22 with secure shell and secure ftp clients, but I cannot connect to the postgres databases on port 5432 (via PGAdminIII). The postgres error says the Server doesn't listen. Postgres is up and running on the machine - the old 1.5.1 instance is still up and using it. Normally I see this error if the postmaster is not running on the server and this can be corrected by starting it. I can connect to the databases on the server using psql - command line, but of course this is cumbersome. 2. I am getting errors when I try to assemble the 1.7.1 application as follows: mvn -U clean package [INFO] Scanning for projects... Downloading: http://repo1.maven.org/maven2/org/dspace/dspace-pom/10/dspace-pom-10.pom [WARNING] Unable to get resource 'org.dspace:dspace-pom:pom:10' from repository central (http://repo1.maven.org/maven2): Error transferring file: Connection refused [INFO] [ERROR] FATAL ERROR [INFO] [INFO] Error building POM (may not be this project's POM). Project ID: org.dspace:dspace-parent:pom:1.7.1 Reason: Cannot find parent: org.dspace:dspace-pom for project: org.dspace:dspace-parent:pom:1.7.1 for project org.dspace:dspace-parent:pom:1.7.1 [INFO] [INFO] Trace org.apache.maven.reactor.MavenExecutionException: Cannot find parent: org.dspace:dspace-pom for project: org.dspace:dspace-parent:pom:1.7.1 for project org.dspace:dspace-parent:pom:1.7.1 at org.apache.maven.DefaultMaven.getProjects(DefaultMaven.java:404) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:272) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:138) at org.apache.maven.cli.MavenCli.main(MavenCli.java:362) at org.apache.maven.cli.compat.CompatibleMain.main(CompatibleMain.java:60) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.codehaus.classworlds.Launcher.launchEnhanced(Launcher.java:315) at org.codehaus.classworlds.Launcher.launch(Launcher.java:255) at org.codehaus.classworlds.Launcher.mainWithExitCode(Launcher.java:430) at org.codehaus.classworlds.Launcher.main(Launcher.java:375) Caused by: org.apache.maven.project.ProjectBuildingException: Cannot find parent: org.dspace:dspace-pom for project: org.dspace:dspace-parent:pom:1.7.1 for project org.dspace:dspace-parent:pom:1.7.1 at org.apache.maven.project.DefaultMavenProjectBuilder.assembleLineage(DefaultMavenProjectBuilder.java:1396) at org.apache.maven.project.DefaultMavenProjectBuilder.assembleLineage(DefaultMavenProjectBuilder.java:1407) at org.apache.maven.project.DefaultMavenProjectBuilder.buildInternal(DefaultMavenProjectBuilder.java:823) at org.apache.maven.project.DefaultMavenProjectBuilder.buildFromSourceFileInternal(DefaultMavenProjectBuilder.java:508) at org.apache.maven.project.DefaultMavenProjectBuilder.build(DefaultMavenProjectBuilder.java:200) at org.apache.maven.DefaultMaven.getProject(DefaultMaven.java:604) at org.apache.maven.DefaultMaven.collectProjects(DefaultMaven.java:487) at org.apache.maven.DefaultMaven.getProjects(DefaultMaven.java:391) ... 12 more Caused by: org.apache.maven.project.ProjectBuildingException: POM 'org.dspace:dspace-pom' not found in repository: Unable to download the artifact from any repository org.dspace:dspace-pom:pom:10 from the specified remote repositories: central (http://repo1.maven.org/maven2) for project org.dspace:dspace-pom at org.apache.maven.project.DefaultMavenProjectBuilder.findModelFromRepository(DefaultMavenProjectBuilder.java:605) at org.apache.maven.project.DefaultMavenProjectBuilder.assembleLineage(DefaultMavenProjectBuilder.java:1392) ... 19 more Caused by: org.apache.maven.artifact.resolver.ArtifactNotFoundException: Unable to download the artifact from any repository org.dspace:dspace-pom:pom:10 from the
Re: [Dspace-tech] Batch import problems
If you execute the Import script and write the output to a file (using filename.out), you should see what the problem is in here. Also check the .map file and see if there is a message in there indicating what the problem is. I've never had the import blow up where there wasn't a message in one of these files indicating what the problem was. Hope this helps, Sue Sue Walker-Thornton (757) 864-2368 From: Blanco, Jose [mailto:blan...@umich.edu] Sent: Friday, November 04, 2011 4:56 PM To: Paul Go; Dspace Tech list; DSpace General Mailing List Subject: Re: [Dspace-tech] Batch import problems The line of code where it blows up seems to be accessing the directory where the data is at. I would check that you are importing from the right directory, and that the permissions there are good. -Jose From: Paul Go [mailto:pgo...@gmail.com] Sent: Friday, November 04, 2011 4:50 PM To: Dspace Tech list; DSpace General Mailing List Subject: [Dspace-tech] Batch import problems We've successfully been able to batch import items into Dspace before but haven't been able to since we've upgraded. We are regularly running into these errors when trying to run the command: java.lang.NullPointerException at java.util.Arrays.sort(Arrays.java:1078) at org.dspace.app.itemimport.ItemImport.addItems(ItemImport.java:606) at org.dspace.app.itemimport.ItemImport.main(ItemImport.java:497) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) java.lang.NullPointerException Started: 1320428221038 Ended: 1320428221196 Elapsed time: 0 secs (158 msecs) Any suggestions or feedback would be appreciated. Paul Go Systems Librarian / Library Technology Manager Paul V. Galvin Library 35 West 33rd Street Chicago, IL 60616 312.567.7997 p...@iit.edumailto:p...@iit.edu -- RSA(R) Conference 2012 Save $700 by Nov 18 Register now http://p.sf.net/sfu/rsa-sfdev2dev1___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Editing Indexes
Saying you want to have a search on identifier.* means that DSpace will index ALL metadata fields where the element = identifier. For example, here are just a few of the metadata fields in our repository where the element = identifier: Identifier.ismn Identifier.issn Identifier.issueNumber Identifier.journalNumber In fact, have 39 metadata fields where the element = identifier. IMHO, I would not want to build a search index on identifier.* because: 1.For us, it would be HUGE since our repository is close to 200,000 Items 2. We don't need to be able to search on every single field where the element = identifier. Hope this helps! Best regards, Sue Sue Walker-Thornton (757) 864-2368 From: Art Gutierrez [mailto:aguti...@emporia.edu] Sent: Wednesday, November 02, 2011 11:11 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Editing Indexes Hello, We are running version 1.7 and the Manakin UI and I am trying to customize the index to include changes I have made in the fields in the submission process. I keep getting an error about a malformed line. The line in question is search.index.9 = identifier:dc.identifier.*-- I have tried editing this line to have no ending punctuation, just a period, and now period and asterisk based on other entries on the index list. My question is what does the ending syntax mean?? I have tried searching the list archives but honestly have not found it real reliable in returning search results. Also, are there other resources out there that people reference besides the documentation and the list serv?? Thanks Art Gutierrez Head of Systems and Technical Services Assistant Professor Emporia State University Agutierr at emporia dot edu 620-341-6205 -- RSA(R) Conference 2012 Save $700 by Nov 18 Register now http://p.sf.net/sfu/rsa-sfdev2dev1___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Questions: 1-building DSpace application 2-converting from JSPUI to XMLUI
Good morning, Question I: I came across a Wiki document this morning @ dspace.org while doing some research on what kind of effort it's going to be for us to migrate our DSpace 1.7.1 JSPUI instance to Manakin/XMLUI (back to that in a minute). This is the document I was looking at: https://wiki.duraspace.org/display/DSPACE/Rebuild+DSpace . I've been working with DSpace since 2005, version 1.3.2 and am always interested in increasing my knowledge of the DSpace application; so I have a question about a statement in this section of the document: Quick Build: (Quick build after smaller, usually JSP based or XMLUI-Theme based, changes) 1. Log on to the server DSpace is running on (e.g. ssh). Make sure to login as the user who initially installed DSpace! 2. Open a command prompt (if you don't have one already), and cd [dspace-source]/dspace/ 3. mvn package (recompiles all DSpace code and rebuilds the DSpace installation package) 4. cd [dspace-source]/dspace/target/dspace-[version]-build.dir/ (move into the target directory where DSpace has been rebuilt) 5. ant update (updates your DSpace install based on the newly built content in your target directory) * Alternatively, if you do not need to reinstall JAR files, you could instead run ant update_webapps (which just copies over web application changes to your [dspace]) 6. If you do not have Tomcat pointing at your [dspace]/webapps/ directory, you will also need to copy your final web application(s) into your [Tomcat]/webapps/ directory. * cp -R [dspace]/webapps/ [Tomcat]/webapps/ * (For Mac OS X Server) cp build/*.war /library/jboss/3.2/deploy 7. Test your changes in DSpace Specifically, my question is in reference to the highlighted text. When would I ...need to reinstall JAR files...? Would it be only if I made a modification to an existing Java program or added a new one? If I just made a change to a .jsp or one of the objects in the /webapps source directory or changed the Messages.properties file, would this be a situation where I could just run ant update_webapps? Question II: We recently upgraded our main DSpace instance from JSPUI version 1.5.1 to 1.7.1. We are now considering implementing Manakin/XMLUI and I'm trying to figure out what kind of effort it's going to be for us to do so. I have been working with DSpace since version 1.3.2 back in 2005 and consider myself to have an excellent working knowledge of the DSpace JSPUI application. I did attend a 2-3 day Manakin class, but it was several years ago at a NITLE conference and I'm not sure how much I remember from it, if anything, because I haven't used the skills I learned since then. I need to come up with an estimate of what kind of effort it's going to take for me to implement Manakin in the following phases: 1. Implement Manakin with one of the default themes (Classic, Reference, Kubrick) so we can use Discovery 2. Add expanding and collapsing interface to community-list hierarchy (see https://wiki.duraspace.org/display/DSPACE/Add+expanding+and+collapsing+interface+to+community-list+hierarchy+%28Manakin%29 ) 3. Possibly create/implement our own theme If anyone out there has done this (convert from JSPUI to XMLUI) and can give me some rough time estimates and any other advise about this task, I would appreciate hearing from you. Thanks!! Best regards, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (C) 757-506-9903 -- RSAreg; Conference 2012 Save #36;700 by Nov 18 Register now http://p.sf.net/sfu/rsa-sfdev2dev1___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Strange problem with searching - More and disturbing information!
What version of DSpace are you running? I just tested something completely unrelated this morning, but it involved adding a second document to an Item, then running filter media, then doing a search to do if the text in the second document was found - it WAS. We are running DSpace 1.7.1. JSPUI. Sue Sue Walker-Thornton (757) 864-2368 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Thursday, October 13, 2011 12:50 PM To: George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Strange problem with searching - More and disturbing information! Hi George, Hmm..that's a bit odd. It's definitely not a known issue. In fact, looking at the DSIndexer class (which is the class which creates/updates the Lucene search index), it should be doing what you expect. The 'buildDocumentForItem()' method is the one that takes care of indexing all Item content into a Lucene Document. https://fisheye3.atlassian.com/browse/~br=trunk/dspace/dspace/trunk/dspace-api/src/main/java/org/dspace/search/DSIndexer.java?hb=true#to1040 Specifically, it should be doing the following: 1. Initialize the Lucene Document for the Item 2. Index all Item Metadata 3. Add in all various sort options (so you can sort search results) 4. Locate the TEXT Bundle in the Item and index *all* Bitstreams in that Bundle. If you turn on Debugging you should actually see the DSIndexer report *every* Bitstream that it adds to the index. So, I'm a bit at a loss as to what may be happening. It sounds like your TEXT bundle is getting all the right Bitstreams added (by filter-media). I'm assuming there is only *one* TEXT Bundle, right? (if there are multiple that may be the issue -- but DSpace itself should only be generating one TEXT bundle). The only other thing I can think of is that your 'search.maxfieldlength' setting is too small. In your dspace.cfg you should see: # Maximum number of terms indexed for a single field in Lucene. # Default is 10,000 words - often not enough for full-text indexing. # If you change this, you'll need to re-index for the change # to take effect on previously added items. # -1 = unlimited (Integer.MAX_VALUE) search.maxfieldlength = 1 So, it could be possible that these PDFs are larger, and Lucene just stops indexing content after 10,000 words. You can set this to -1 if you want to disable any word-based limit. Not sure if that helps or not! :) - Tim On 10/13/2011 11:28 AM, George S Kozak wrote: Hi. Everyone: After a bit of digging what I have discovered is that any item that has multiple bitstreams of PDFs, only the first bitstream added is searchable. The other bitstreams in the item seem to be ignored by the indexer. I have checked and the extracted Texts are there, so it is not an issue with the filter-media program. We (at Cornell) have many items with multiple bitstreams of PDFs, and so far all of my testing indicates only the first bitstream of the item is being indexed by the Dspace search engine. Is this a known issue? Is there something wrong in my configuration files that may be causing this? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Strange problem with searching - More and disturbing information!
We also have search.maxfieldlength set to -1. Sue Sue Walker-Thornton (757) 864-2368 -Original Message- From: George S Kozak [mailto:g...@cornell.edu] Sent: Thursday, October 13, 2011 1:09 PM To: Thornton, Susan M. (LARC-B702)[LITES]; Tim Donohue Cc: dspace-tech@lists.sourceforge.net Subject: RE: [Dspace-tech] Strange problem with searching - More and disturbing information! Susan: I am running DSpace 1.7.1...I think Tim may be right about my config settings (thanks for the suggestions, Tim). I am going to test that out and I will let everyone know. George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -Original Message- From: Thornton, Susan M. (LARC-B702)[LITES] [mailto:susan.m.thorn...@nasa.gov] Sent: Thursday, October 13, 2011 1:04 PM To: Tim Donohue; George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: RE: [Dspace-tech] Strange problem with searching - More and disturbing information! What version of DSpace are you running? I just tested something completely unrelated this morning, but it involved adding a second document to an Item, then running filter media, then doing a search to do if the text in the second document was found - it WAS. We are running DSpace 1.7.1. JSPUI. Sue Sue Walker-Thornton (757) 864-2368 -Original Message- From: Tim Donohue [mailto:tdono...@duraspace.org] Sent: Thursday, October 13, 2011 12:50 PM To: George S Kozak Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Strange problem with searching - More and disturbing information! Hi George, Hmm..that's a bit odd. It's definitely not a known issue. In fact, looking at the DSIndexer class (which is the class which creates/updates the Lucene search index), it should be doing what you expect. The 'buildDocumentForItem()' method is the one that takes care of indexing all Item content into a Lucene Document. https://fisheye3.atlassian.com/browse/~br=trunk/dspace/dspace/trunk/dspace-api/src/main/java/org/dspace/search/DSIndexer.java?hb=true#to1040 Specifically, it should be doing the following: 1. Initialize the Lucene Document for the Item 2. Index all Item Metadata 3. Add in all various sort options (so you can sort search results) 4. Locate the TEXT Bundle in the Item and index *all* Bitstreams in that Bundle. If you turn on Debugging you should actually see the DSIndexer report *every* Bitstream that it adds to the index. So, I'm a bit at a loss as to what may be happening. It sounds like your TEXT bundle is getting all the right Bitstreams added (by filter-media). I'm assuming there is only *one* TEXT Bundle, right? (if there are multiple that may be the issue -- but DSpace itself should only be generating one TEXT bundle). The only other thing I can think of is that your 'search.maxfieldlength' setting is too small. In your dspace.cfg you should see: # Maximum number of terms indexed for a single field in Lucene. # Default is 10,000 words - often not enough for full-text indexing. # If you change this, you'll need to re-index for the change # to take effect on previously added items. # -1 = unlimited (Integer.MAX_VALUE) search.maxfieldlength = 1 So, it could be possible that these PDFs are larger, and Lucene just stops indexing content after 10,000 words. You can set this to -1 if you want to disable any word-based limit. Not sure if that helps or not! :) - Tim On 10/13/2011 11:28 AM, George S Kozak wrote: Hi. Everyone: After a bit of digging what I have discovered is that any item that has multiple bitstreams of PDFs, only the first bitstream added is searchable. The other bitstreams in the item seem to be ignored by the indexer. I have checked and the extracted Texts are there, so it is not an issue with the filter-media program. We (at Cornell) have many items with multiple bitstreams of PDFs, and so far all of my testing indicates only the first bitstream of the item is being indexed by the Dspace search engine. Is this a known issue? Is there something wrong in my configuration files that may be causing this? George Kozak Digital Library Specialist Cornell University Library Information Technologies (CUL-IT) 501 Olin Library Cornell University Ithaca, NY 14853 607-255-8924 -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Memory isues on Java
I periodically get this error and sometimes stopping and restarting your web server will at least temporarily solve this problem. What memory size are you using? We use the following and rarely see this error anymore: JAVA_OPTS=-Xms2048m -Xmx3072m -Xss512k -Dfile.encoding=UTF-8 Hope this helps. Best regards, Sue Sue Walker-Thornton (757) 864-2368 From: Lewatle Phaladi [mailto:lewatle.phal...@wits.ac.za] Sent: Wednesday, October 12, 2011 4:59 AM To: dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Memory isues on Java Dear Dspace Team I have tried increasing memory size in java configuration file but I still get this error when I want to create image thumbnails, any idea on what I can do to erase this error for good? -bash-3.00$ ./dspace filter-media Exception: Java heap space java.lang.OutOfMemoryError: Java heap space at java.awt.image.DataBufferByte.init(DataBufferByte.java:58) at java.awt.image.ComponentSampleModel.createDataBuffer(ComponentSampleModel.java:397) at java.awt.image.Raster.createWritableRaster(Raster.java:938) at javax.imageio.ImageTypeSpecifier.createBufferedImage(ImageTypeSpecifier.java:1056) at javax.imageio.ImageReader.getDestination(ImageReader.java:2879) at com.sun.imageio.plugins.jpeg.JPEGImageReader.readInternal(JPEGImageReader.java:980) at com.sun.imageio.plugins.jpeg.JPEGImageReader.read(JPEGImageReader.java:948) at javax.imageio.ImageIO.read(ImageIO.java:1422) at javax.imageio.ImageIO.read(ImageIO.java:1326) at org.dspace.app.mediafilter.JPEGFilter.getDestinationStream(JPEGFilter.java:67) at org.dspace.app.mediafilter.MediaFilterManager.processBitstream(MediaFilterManager.java:737) at org.dspace.app.mediafilter.MediaFilterManager.filterBitstream(MediaFilterManager.java:561) at org.dspace.app.mediafilter.MediaFilterManager.filterItem(MediaFilterManager.java:511) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersItem(MediaFilterManager.java:479) at org.dspace.app.mediafilter.MediaFilterManager.applyFiltersAllItems(MediaFilterManager.java:414) at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:333) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) -bash-3.00$ Regards, Lewatle This communication is intended for the addressee only. It is confidential. If you have received this communication in error, please notify us immediately and destroy the original message. You may not copy or disseminate this communication without the permission of the University. Only authorized signatories are competent to enter into agreements on behalf of the University and recipients are thus advised that the content of this message may not be legally binding on the University and may contain the personal views and opinions of the author, which are not necessarily the views and opinions of The University of the Witwatersrand, Johannesburg. All agreements between the University and outsiders are subject to South African Law unless the University agrees in writing to the contrary. -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2d-oct___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] About Java Unknown failure when filtering media with XPDF
It's hard to tell if it's the email, but it looks like you may need line continuation characters in your filter.plugins specification. In my email, yours appears as: filter.plugins = PDF Thumbnail, PDF Text Extractor, HTML Text Extractor, PowerPoint Text Extractor, Word Text Extractor, JPEG Thumbnail Here's how mine looks in dspace.cfg: #Names of the enabled MediaFilter or FormatFilter plugins filter.plugins = PDF Text Extractor, HTML Text Extractor, \ PowerPoint Text Extractor, \ Word Text Extractor Hope this helps! Best regards, Sue -Original Message- From: Antonio Calderón [mailto:neocalde...@gmail.com] Sent: Monday, September 26, 2011 1:14 PM To: Stuart Lewis Cc: Scott Thurston; DSpace Tech Subject: Re: [Dspace-tech] About Java Unknown failure when filtering media with XPDF Scott, how are you? My configuration: # maximum width and height of generated thumbnails thumbnail.maxwidth = 80 thumbnail.maxheight = 80 #XPDF xpdf.path.pdftotext = /usr/bin/pdftotext xpdf.path.pdftoppm = /usr/bin/pdftoppm xpdf.path.pdfinfo = /usr/bin/pdfinfo plugin.named.org.dspace.app.mediafilter.FormatFilter = \ org.dspace.app.mediafilter.XPDF2Text = PDF Text Extractor, \ org.dspace.app.mediafilter.XPDF2Thumbnail = PDF Thumbnail, \ org.dspace.app.mediafilter.HTMLFilter = HTML Text Extractor, \ org.dspace.app.mediafilter.WordFilter = Word Text Extractor, \ org.dspace.app.mediafilter.PowerPointFilter = PowerPoint Text Extractor, \ org.dspace.app.mediafilter.JPEGFilter = JPEG Thumbnail, \ org.dspace.app.mediafilter.BrandedPreviewJPEGFilter = Branded Preview JPEG filter.org.dspace.app.mediafilter.XPDF2Text.inputFormats = Adobe PDF filter.org.dspace.app.mediafilter.XPDF2Thumbnail.inputFormats = Adobe PDF filter.org.dspace.app.mediafilter.HTMLFilter.inputFormats = HTML, Text filter.org.dspace.app.mediafilter.WordFilter.inputFormats = Microsoft Word filter.org.dspace.app.mediafilter.PowerPointFilter.inputFormats = Microsoft Powerpoint, Microsoft Powerpoint XML filter.org.dspace.app.mediafilter.JPEGFilter.inputFormats = BMP, GIF, JPEG, image/png filter.org.dspace.app.mediafilter.BrandedPreviewJPEGFilter.inputFormats = BMP, GIF, JPEG, image/png #Names of the enabled MediaFilter or FormatFilter plugins filter.plugins = PDF Thumbnail, PDF Text Extractor, HTML Text Extractor, PowerPoint Text Extractor, Word Text Extractor, JPEG Thumbnail After correction, another error: ./dspace filter-media ERROR: Unknown MediaFilter specified (either from command-line or in dspace.cfg): 'PDF Thumbnail' Thank you, A. 2011/9/26 Stuart Lewis s.le...@auckland.ac.nz: Hi Antonio, In your [dspace]/config/dspace.cfg file, what do you have set for the 'filter.plugins' setting? The error you sent suggested that there is is no 'filter.plugins' set in your dspace.cfg. A typical value you be: filter.plugins = PDF Text Extractor, HTML Text Extractor, \ PowerPoint Text Extractor, \ Word Text Extractor, JPEG Thumbnail Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 26/09/2011, at 6:33 PM, Antonio Calderón wrote: Hi Scott, I followed the instructions, but get this: Exception: null java.lang.NullPointerException at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:214) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) Thank you very much for your help, A. 2011/9/23 Scott Thurston scott.thurs...@noaa.gov: Hello Antonio, Are you able to install your own JDK and configure your environment to use it to build, install and run DSpace? Your $JAVA_HOME should point to the new JDK. If you have downloaded the jai_imageio JAR file for your system, you can unzip it to extract the installer jai_imageio*.bin. The installer is a shell script that contains the binary installer image at the end of the file. Search the installer for the tail command, which looks like this in my installer: tail +215 $0 $outname I was able to get the installer to work by following these steps: 1. tail -n +215 jai_imageio-1_1-lib-linux-amd64-jdk.bin $JAVA_HOME/jai_installer 2. cd $JAVA_HOME 3. ./jai_installer Those steps should install the JAI ImageIO library in your JDK. I hope that is helpful. Regards, Scott On 9/22/2011 10:27 PM, neocalde...@gmail.com wrote: Hi, how do you do? Sorry to contact you directly. About: UPDATE:
[Dspace-tech] Problem with index-init and filter-media in DSpace 1.7.1
We just went live with DSpace 1.7.1 in Production after upgrading from 1.5.1 to 1.7.1 and we’re having problems with both index-init and filter-media. Our indexes take about 5 hours to build and right at the end, both jobs fail with the following errors: request: http://oursite/solr/statistics/update?wt=javabinversion=1 2011-08-22 12:37:50,716 ERROR org.dspace.search.DSIndexer @ background merge hit exception: _u88:C181167 _u89:c1 _u8a:c20 _u8b:c20 _u8c:c20 _u8d:c18 into _u8e [optimize] [mergeDocStores] java.io.IOException: background merge hit exception: _u88:C181167 _u89:c1 _u8a:c20 _u8b:c20 _u8c:c20 _u8d:c18 into _u8e [optimize] [mergeDocStores] at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2908) at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2843) at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2813) at org.dspace.search.DSIndexer.optimizeIndex(DSIndexer.java:411) at org.dspace.search.DSIndexer.updateIndex(DSIndexer.java:588) at org.dspace.search.DSIndexer.updateIndex(DSIndexer.java:539) at org.dspace.app.mediafilter.MediaFilterManager.main(MediaFilterManager.java:381) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) Caused by: java.io.IOException: No space left on device at java.io.RandomAccessFile.writeBytes(Native Method) at java.io.RandomAccessFile.write(RandomAccessFile.java:466) at org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexOutput.flushBuffer(SimpleFSDirectory.java:192) at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:96) at org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:85) at org.apache.lucene.store.BufferedIndexOutput.writeBytes(BufferedIndexOutput.java:75) at org.apache.lucene.store.IndexOutput.writeBytes(IndexOutput.java:43) at org.apache.lucene.index.CompoundFileWriter.copyFile(CompoundFileWriter.java:229) at org.apache.lucene.index.CompoundFileWriter.close(CompoundFileWriter.java:184) at org.apache.lucene.index.SegmentMerger.createCompoundFile(SegmentMerger.java:217) at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:5222) at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4675) at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:235) at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:291) 2011-08-22 12:37:51,072 ERROR org.dspace.kernel.DSpaceKernelManager @ WARN Failed to unregister the MBean: org.dspace:name=3ad4f6f8-7449-478d-99f5-10aa11360763,type=DSpaceKernel 2011-08-22 12:41:08,335 INFO org.dspace.app.webui.servlet.SimpleSearchServlet @ anonymous:session_id=8F2024E9D25A224752DAD674B3A38CA4:ip_addr=146.165.68.35:search:query=ca024312,results=(0,0,1) 2011-08-22 12:41:10,245 INFO org.dspace.usage.LoggerUsageEventListener @ anonymous:session_id=8F2024E9D25A224752DAD674B3A38CA4:ip_addr=146.165.68.35:view_item:handle=2121/337042 2011-08-22 12:41:10,274 ERROR org.dspace.statistics.SolrLoggerUsageEventListener @ Not found Not found request: http://oursite/solr/statistics/update?wt=javabinversion=1 I did some Googling and found something about maybe this is a problem with the indexes being accessed while being built…? If anyone can help, I would really appreciate it. Btw, we are running on Sun Solaris 10, PostgreSQL 8.2.5. Also, we have not implemented our statistics yet so I haven’t even started trying to figure out where the SOLR errors are coming from. Thanks, Sue Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center|LITES Contract SGT, Inc.|130 Research Drive Hampton, Va. 23666 Office: (757) 224-4074 Mobile: (757) 506-9903 Fax: (757) 224-4001 susan.m.thorn...@nasa.gov -- uberSVN's rich system and user administration capabilities and model configuration take the hassle out of deploying and managing Subversion and the tools developers use with it. Learn more about uberSVN and get a free download at: http://p.sf.net/sfu/wandisco-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
