Hallo Tim, Thanks for your response. We have numerous error messages, and I have not yet been able to trace them to a single cause. At first I thought they were related to the outofmemory error because of the time the RSS errors occurred. That seemed to coincide with the filtermedia and stats cronjobs. However, the cronjobs run at night, and the RSS errors occur throughout the day.
There are times when the RSS feeds are shown as they should. Just now I repeatedly tested several RSS feeds. But then suddenly, the RSS feeds start giving the errors I posted. So, there must be something else going on as well. However, I have set the new RSS parameters in dspace.cfg. My intention was to not show the hidden items. #### Restricted item visibilty settings ### # By default RSS feeds, OAI-PMH and subscription emails will include ALL items # regardless of permissions set on them. # # If you wish to only expose items through these channels where the ANONYMOUS # user is granted READ permission, then set the following options to false harvest.includerestricted.rss = false #harvest.includerestricted.oai = false harvest.includerestricted.subscription = false # enable syndication feeds - links display on community and collection home pages # (This setting is not used by XMLUI, as you enable feeds in your theme) webui.feed.enable = true # number of DSpace items per feed (the most recent submissions) webui.feed.items = 10 # maximum number of feeds in memory cache # value of 0 will disable caching webui.feed.cache.size = 100 # number of hours to keep cached feeds before checking currency # value of 0 will force a check with each request webui.feed.cache.age = 48 # which syndication formats to offer # use one or more (comma-separated) values from list: # rss_0.90, rss_0.91, rss_0.92, rss_0.93, rss_0.94, rss_1.0, rss_2.0 webui.feed.formats = rss_1.0,rss_2.0 # URLs returned by the feed will point at the global handle server (e.g. http://hdl.handle.net/123456789/1) # Set to true to use local server URLs (i.e. http://myserver.myorg/handle/123456789/1) webui.feed.localresolve = false We have not changed any DSpace code, other than in some of the layout jsp pages to add an additional google search box, and changes to the styles.jsp. We have run all database upgrade scripts. We made one modification to the database upgrade script, and that is that we can not drop the mets_bitstream_id column, because that column is still used. I have posted an message about that some months ago. I'll ask the DBA to check the tables for the upgrade changes. So far I have looked at the Tomcat catalina.out and localhost.log files and the dspace logging. I'll ask the DBA to check the Oracle logging. In addition to the stack trace dspace lists in the error message, Tomcat logs this error org.dspace.authorize.AuthorizeException: Authorization denied for action READ on BITSTREAM:124 by user 0 at org.dspace.authorize.AuthorizeManager.authorizeAction(AuthorizeManager.java:196) at org.dspace.content.Bitstream.retrieve(Bitstream.java:561) at org.dspace.app.mets.METSExport.findLicense(METSExport.java:593) at org.dspace.app.mets.METSExport.writeMETS(METSExport.java:397) at org.dspace.app.oai.METSCrosswalk.createMetadata(METSCrosswalk.java:82) at ORG.oclc.oai.server.catalog.RecordFactory.create(RecordFactory.java:332) at ORG.oclc.oai.server.catalog.RecordFactory.create(RecordFactory.java:243) at ORG.oclc.oai.server.catalog.RecordFactory.create(RecordFactory.java:211) at org.dspace.app.oai.DSpaceOAICatalog.doRecordHarvest(DSpaceOAICatalog.java:578) at org.dspace.app.oai.DSpaceOAICatalog.listRecords(DSpaceOAICatalog.java:445) at ORG.oclc.oai.server.verb.ListRecords.construct(ListRecords.java:180) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:592) at ORG.oclc.oai.server.OAIHandler.getResult(OAIHandler.java:383) at ORG.oclc.oai.server.OAIHandler.doGet(OAIHandler.java:292) at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:845) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447) at java.lang.Thread.run(Thread.java:595) Thank you for your assistance, Best wishes, Francis Brouns -----Oorspronkelijk bericht----- Van: Tim Donohue [mailto:tdono...@duraspace.org] Verzonden: maandag 26 juli 2010 16:44 Aan: Brouns, Francis CC: dspace-tech@lists.sourceforge.net Onderwerp: Re: [Dspace-tech] Authorisation error on rss feeds Francis, That error does not seem to be related to OutOfMemory problems or even database connection problems (especially since you said everything else is working properly -- and only RSS feeds seem affected). It's odd, according to the error message (and the lines that it reports), it seems the query to find all recently changed items is either erroring out, or responding with null values. Have you made any customizations to RSS feeds in the past? It's odd for *only* RSS feeds to be affected, if everything else is working properly. Are you certain that your 1.4.2 to 1.5.2 upgrade was successful (did you remember to run all database upgrade scripts)? Are there any other error messages appearing in your logs? You might even want to check Oracle's logs to see if it is reporting database level errors. Hopefully if you can dig into your logs (especially Oracle's logs) a bit deeper maybe we can help you find the cause of these errors. - Tim On 7/26/2010 8:12 AM, Brouns, Francis wrote: > Hi all, > > We are still running into outofmemory errors, but these do not co-incide with > the RSS problems. At times that the RSS requests are made, other requests are > still being handled and the pages are shown. It are just the RSS requests > that results in NullPointerExceptions. > > Is it possible that we run out of database connections? How would I check for > that? We use Oracle10.2, running on a separate server. We had to install the > 10.2.0.2 jdbc driver, because the dspace installation complained about the > 10.2.4 jdbc driver we initially used. > > In dspace.cfg the default values for the database pool and connections > parameters are being used. > > Best wishes, > Francis Brouns > > > > > -----Oorspronkelijk bericht----- > Van: Brouns, Francis [mailto:francis.bro...@ou.nl] > Verzonden: zondag 25 juli 2010 18:32 > Aan: dspace-tech@lists.sourceforge.net > Onderwerp: Re: [Dspace-tech] Authorisation error on rss feeds > > Hi all, > > assigning more memory (2GB) to Tomcat has not solved our problem. Once the > cronjobs for the filtermedia and stats have started, all RSS requests again > result in > > java.lang.NullPointerException > at > org.dspace.authorize.AuthorizeManager.getAuthorizedGroups(AuthorizeManager.java:718) > at org.dspace.search.Harvest.harvest(Harvest.java:273) > at > org.dspace.app.webui.servlet.FeedServlet.itemsChanged(FeedServlet.java:281) > at > org.dspace.app.webui.servlet.FeedServlet.doDSGet(FeedServlet.java:230) > at > org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:151) > at > org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) > at > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) > at > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) > at > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) > at > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) > at > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) > at > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286) > at > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:845) > at > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583) > at > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447) > at java.lang.Thread.run(Thread.java:595) > > > The server has 6GB RAM. We have assigned 2GB to Tomcat and 512M to other java > processes. Running DSpace 1.5.2, on SLES11, Tomcat6 and SUN Java 1.5. > > Any ideas on how to solve this? > > Best regards, > Francis Brouns > > ________________________________________ > From: Brouns, Francis [francis.bro...@ou.nl] > Sent: 23 July 2010 16:14 > To: 'Bram Luyten' > Cc: dspace-tech@lists.sourceforge.net > Subject: Re: [Dspace-tech] Authorisation error on rss feeds > > Hi Bram, > > it seems related to our memory problems. Restarting Tomcat solved the problem > and RSS are shown as they should. We have increased memory allocation to > Tomcat from 1GB to 2GB, in the hope we can prevent running out of memory. > It remains strange though, because the site would display normally. Only the > RSS feeds were giving errors. > > Regards, > Francis Brouns > > > ________________________________ > Van: bluy...@gmail.com [mailto:bluy...@gmail.com] Namens Bram Luyten > Verzonden: vrijdag 23 juli 2010 13:57 > Aan: Brouns, Francis > CC: dspace-tech@lists.sourceforge.net > Onderwerp: Re: [Dspace-tech] Authorisation error on rss feeds > > Hi Francis, > > does the problem go away when you change: > > #harvest.includerestricted.oai = false > > into > > harvest.includerestricted.oai = true ? > > I'm not sure, but the ListIdentifiers call might also be used for the RSS, so > it's related to http://jira.dspace.org/jira/browse/DS-212 > In any case, that specific error is fixed in DSpace 1.6 with the attached > patch. > > regards, > > Bram Luyten > > @mire - http://www.atmire.com > > Technologielaan 9 - 3001 Heverlee - Belgium > 533 2nd Street - Encinitas, CA 92024 - USA > > http://www.togather.eu - Before getting together, get t...@ther > > > On Fri, Jul 23, 2010 at 11:47 AM, Brouns, > Francis<francis.bro...@ou.nl<mailto:francis.bro...@ou.nl>> wrote: > Hi, > > Last week we upgraded our DSpace 1.4.2 server to DSpace 1.5.2. The tests at > the testserver went all fine. Now on the production server we are running > into problems we did not encounter at the testserver. For example with the > RSS feeds. > > The configuration in dspace.cfg is: > harvest.includerestricted.rss = false > #harvest.includerestricted.oai = false > harvest.includerestricted.subscription = false > > On the test server this is working fine. On the new production server, we get > internal server errors on the RSS feeds. An example error message is given > below. > > On the mailing list there are comparable messages, but they refer to the > OAI-PMH harvest. In our case, the harvest is not causing any problems. > > Any tips on how to trace the source of this problem are welcome. > > -- URL Was: http://dspace.ou.nl/feed/rss_2.0/site > -- Method: GET > -- Parameters were: > > > Exception: > java.lang.NullPointerException > at > org.dspace.authorize.AuthorizeManager.getAuthorizedGroups(AuthorizeManager.java:718) > at org.dspace.search.Harvest.harvest(Harvest.java:273) > at > org.dspace.app.webui.servlet.FeedServlet.itemsChanged(FeedServlet.java:281) > at > org.dspace.app.webui.servlet.FeedServlet.doDSGet(FeedServlet.java:230) > at > org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:151) > at > org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) > at > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) > at > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) > at > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) > at > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) > at > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) > at > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286) > at > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:845) > at > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583) > at > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447) > at java.lang.Thread.run(Thread.java:595) > > Kind regards, > Francis Brouns > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by Sprint > What will you do first with EVO, the first 4G phone? > Visit sprint.com/first<http://sprint.com/first> -- > http://p.sf.net/sfu/sprint-com-first > _______________________________________________ > DSpace-tech mailing list > DSpace-tech@lists.sourceforge.net<mailto:DSpace-tech@lists.sourceforge.net> > https://lists.sourceforge.net/lists/listinfo/dspace-tech > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by Sprint > What will you do first with EVO, the first 4G phone? > Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first > _______________________________________________ > DSpace-tech mailing list > DSpace-tech@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/dspace-tech > > ------------------------------------------------------------------------------ > The Palm PDK Hot Apps Program offers developers who use the > Plug-In Development Kit to bring their C/C++ apps to Palm for a share > of $1 Million in cash or HP Products. Visit us here for more details: > http://ad.doubleclick.net/clk;226879339;13503038;l? > http://clk.atdmt.com/CRS/go/247765532/direct/01/ > _______________________________________________ > DSpace-tech mailing list > DSpace-tech@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/dspace-tech ------------------------------------------------------------------------------ The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://ad.doubleclick.net/clk;226879339;13503038;l? http://clk.atdmt.com/CRS/go/247765532/direct/01/ _______________________________________________ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
