Francis, One other thing that came to mind:
If the RSS feeds work at times, is it only certain RSS feeds that have this problem? So, if this error is consistently only coming from a particular Community or Collection RSS feed, then that may point to something being corrupt (or just slightly broken) with the database entries for that Community or Collection. However, if the RSS feed for one Community or Collection will at times work fine and at other times fail, then that's another issue altogether. If this is what is happening, then it could point to a user restriction issue (which it looks like you've configured properly though) or maybe something with Oracle, like a connection or pooling issue, perhaps. At a glance all your configuration settings look fine. The AuthorizeException looks unrelated to your RSS feeds issue. But, it is coming from an OAI-PMH harvest (if you look in that error message you'll see the OAI-PMH classes mentioned -- e.g. "DSpaceOAICatalog"). The RSS feeds have nothing to do with the OAI-PMH interface, so these issues are unrelated. - Tim On 7/27/2010 7:09 AM, Brouns, Francis wrote: > Hallo Tim, > > Thanks for your response. We have numerous error messages, and I have not yet > been able to trace them to a single cause. At first I thought they were > related to the outofmemory error because of the time the RSS errors occurred. > That seemed to coincide with the filtermedia and stats cronjobs. However, the > cronjobs run at night, and the RSS errors occur throughout the day. > > There are times when the RSS feeds are shown as they should. Just now I > repeatedly tested several RSS feeds. But then suddenly, the RSS feeds start > giving the errors I posted. So, there must be something else going on as > well. However, I have set the new RSS parameters in dspace.cfg. My intention > was to not show the hidden items. > > #### Restricted item visibilty settings ### > # By default RSS feeds, OAI-PMH and subscription emails will include ALL items > # regardless of permissions set on them. > # > # If you wish to only expose items through these channels where the ANONYMOUS > # user is granted READ permission, then set the following options to false > harvest.includerestricted.rss = false > #harvest.includerestricted.oai = false > harvest.includerestricted.subscription = false > > # enable syndication feeds - links display on community and collection home > pages > # (This setting is not used by XMLUI, as you enable feeds in your theme) > webui.feed.enable = true > # number of DSpace items per feed (the most recent submissions) > webui.feed.items = 10 > # maximum number of feeds in memory cache > # value of 0 will disable caching > webui.feed.cache.size = 100 > # number of hours to keep cached feeds before checking currency > # value of 0 will force a check with each request > webui.feed.cache.age = 48 > # which syndication formats to offer > # use one or more (comma-separated) values from list: > # rss_0.90, rss_0.91, rss_0.92, rss_0.93, rss_0.94, rss_1.0, rss_2.0 > webui.feed.formats = rss_1.0,rss_2.0 > # URLs returned by the feed will point at the global handle server (e.g. > http://hdl.handle.net/123456789/1) > # Set to true to use local server URLs (i.e. > http://myserver.myorg/handle/123456789/1) > webui.feed.localresolve = false > > > We have not changed any DSpace code, other than in some of the layout jsp > pages to add an additional google search box, and changes to the styles.jsp. > > We have run all database upgrade scripts. We made one modification to the > database upgrade script, and that is that we can not drop the > mets_bitstream_id column, because that column is still used. I have posted an > message about that some months ago. I'll ask the DBA to check the tables for > the upgrade changes. > > So far I have looked at the Tomcat catalina.out and localhost.log files and > the dspace logging. I'll ask the DBA to check the Oracle logging. > > In addition to the stack trace dspace lists in the error message, Tomcat logs > this error > > org.dspace.authorize.AuthorizeException: Authorization denied for action READ > on BITSTREAM:124 by user 0 > at > org.dspace.authorize.AuthorizeManager.authorizeAction(AuthorizeManager.java:196) > at org.dspace.content.Bitstream.retrieve(Bitstream.java:561) > at org.dspace.app.mets.METSExport.findLicense(METSExport.java:593) > at org.dspace.app.mets.METSExport.writeMETS(METSExport.java:397) > at > org.dspace.app.oai.METSCrosswalk.createMetadata(METSCrosswalk.java:82) > at > ORG.oclc.oai.server.catalog.RecordFactory.create(RecordFactory.java:332) > at > ORG.oclc.oai.server.catalog.RecordFactory.create(RecordFactory.java:243) > at > ORG.oclc.oai.server.catalog.RecordFactory.create(RecordFactory.java:211) > at > org.dspace.app.oai.DSpaceOAICatalog.doRecordHarvest(DSpaceOAICatalog.java:578) > at > org.dspace.app.oai.DSpaceOAICatalog.listRecords(DSpaceOAICatalog.java:445) > at > ORG.oclc.oai.server.verb.ListRecords.construct(ListRecords.java:180) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:592) > at ORG.oclc.oai.server.OAIHandler.getResult(OAIHandler.java:383) > at ORG.oclc.oai.server.OAIHandler.doGet(OAIHandler.java:292) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) > at > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) > at > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) > at > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) > at > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) > at > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) > at > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286) > at > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:845) > at > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583) > at > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447) > at java.lang.Thread.run(Thread.java:595) > > Thank you for your assistance, > Best wishes, > Francis Brouns > > -----Oorspronkelijk bericht----- > Van: Tim Donohue [mailto:[email protected]] > Verzonden: maandag 26 juli 2010 16:44 > Aan: Brouns, Francis > CC: [email protected] > Onderwerp: Re: [Dspace-tech] Authorisation error on rss feeds > > Francis, > > That error does not seem to be related to OutOfMemory problems or even > database connection problems (especially since you said everything else > is working properly -- and only RSS feeds seem affected). > > It's odd, according to the error message (and the lines that it > reports), it seems the query to find all recently changed items is > either erroring out, or responding with null values. > > Have you made any customizations to RSS feeds in the past? It's odd for > *only* RSS feeds to be affected, if everything else is working properly. > > Are you certain that your 1.4.2 to 1.5.2 upgrade was successful (did you > remember to run all database upgrade scripts)? Are there any other > error messages appearing in your logs? You might even want to check > Oracle's logs to see if it is reporting database level errors. > > Hopefully if you can dig into your logs (especially Oracle's logs) a bit > deeper maybe we can help you find the cause of these errors. > > - Tim > > On 7/26/2010 8:12 AM, Brouns, Francis wrote: >> Hi all, >> >> We are still running into outofmemory errors, but these do not co-incide >> with the RSS problems. At times that the RSS requests are made, other >> requests are still being handled and the pages are shown. It are just the >> RSS requests that results in NullPointerExceptions. >> >> Is it possible that we run out of database connections? How would I check >> for that? We use Oracle10.2, running on a separate server. We had to install >> the 10.2.0.2 jdbc driver, because the dspace installation complained about >> the 10.2.4 jdbc driver we initially used. >> >> In dspace.cfg the default values for the database pool and connections >> parameters are being used. >> >> Best wishes, >> Francis Brouns >> >> >> >> >> -----Oorspronkelijk bericht----- >> Van: Brouns, Francis [mailto:[email protected]] >> Verzonden: zondag 25 juli 2010 18:32 >> Aan: [email protected] >> Onderwerp: Re: [Dspace-tech] Authorisation error on rss feeds >> >> Hi all, >> >> assigning more memory (2GB) to Tomcat has not solved our problem. Once the >> cronjobs for the filtermedia and stats have started, all RSS requests again >> result in >> >> java.lang.NullPointerException >> at >> org.dspace.authorize.AuthorizeManager.getAuthorizedGroups(AuthorizeManager.java:718) >> at org.dspace.search.Harvest.harvest(Harvest.java:273) >> at >> org.dspace.app.webui.servlet.FeedServlet.itemsChanged(FeedServlet.java:281) >> at >> org.dspace.app.webui.servlet.FeedServlet.doDSGet(FeedServlet.java:230) >> at >> org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:151) >> at >> org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) >> at >> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) >> at >> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) >> at >> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) >> at >> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) >> at >> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) >> at >> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) >> at >> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) >> at >> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286) >> at >> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:845) >> at >> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583) >> at >> org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447) >> at java.lang.Thread.run(Thread.java:595) >> >> >> The server has 6GB RAM. We have assigned 2GB to Tomcat and 512M to other >> java processes. Running DSpace 1.5.2, on SLES11, Tomcat6 and SUN Java 1.5. >> >> Any ideas on how to solve this? >> >> Best regards, >> Francis Brouns >> >> ________________________________________ >> From: Brouns, Francis [[email protected]] >> Sent: 23 July 2010 16:14 >> To: 'Bram Luyten' >> Cc: [email protected] >> Subject: Re: [Dspace-tech] Authorisation error on rss feeds >> >> Hi Bram, >> >> it seems related to our memory problems. Restarting Tomcat solved the >> problem and RSS are shown as they should. We have increased memory >> allocation to Tomcat from 1GB to 2GB, in the hope we can prevent running out >> of memory. >> It remains strange though, because the site would display normally. Only the >> RSS feeds were giving errors. >> >> Regards, >> Francis Brouns >> >> >> ________________________________ >> Van: [email protected] [mailto:[email protected]] Namens Bram Luyten >> Verzonden: vrijdag 23 juli 2010 13:57 >> Aan: Brouns, Francis >> CC: [email protected] >> Onderwerp: Re: [Dspace-tech] Authorisation error on rss feeds >> >> Hi Francis, >> >> does the problem go away when you change: >> >> #harvest.includerestricted.oai = false >> >> into >> >> harvest.includerestricted.oai = true ? >> >> I'm not sure, but the ListIdentifiers call might also be used for the RSS, >> so it's related to http://jira.dspace.org/jira/browse/DS-212 >> In any case, that specific error is fixed in DSpace 1.6 with the attached >> patch. >> >> regards, >> >> Bram Luyten >> >> @mire - http://www.atmire.com >> >> Technologielaan 9 - 3001 Heverlee - Belgium >> 533 2nd Street - Encinitas, CA 92024 - USA >> >> http://www.togather.eu - Before getting together, get t...@ther >> >> >> On Fri, Jul 23, 2010 at 11:47 AM, Brouns, >> Francis<[email protected]<mailto:[email protected]>> wrote: >> Hi, >> >> Last week we upgraded our DSpace 1.4.2 server to DSpace 1.5.2. The tests at >> the testserver went all fine. Now on the production server we are running >> into problems we did not encounter at the testserver. For example with the >> RSS feeds. >> >> The configuration in dspace.cfg is: >> harvest.includerestricted.rss = false >> #harvest.includerestricted.oai = false >> harvest.includerestricted.subscription = false >> >> On the test server this is working fine. On the new production server, we >> get internal server errors on the RSS feeds. An example error message is >> given below. >> >> On the mailing list there are comparable messages, but they refer to the >> OAI-PMH harvest. In our case, the harvest is not causing any problems. >> >> Any tips on how to trace the source of this problem are welcome. >> >> -- URL Was: http://dspace.ou.nl/feed/rss_2.0/site >> -- Method: GET >> -- Parameters were: >> >> >> Exception: >> java.lang.NullPointerException >> at >> org.dspace.authorize.AuthorizeManager.getAuthorizedGroups(AuthorizeManager.java:718) >> at org.dspace.search.Harvest.harvest(Harvest.java:273) >> at >> org.dspace.app.webui.servlet.FeedServlet.itemsChanged(FeedServlet.java:281) >> at >> org.dspace.app.webui.servlet.FeedServlet.doDSGet(FeedServlet.java:230) >> at >> org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:151) >> at >> org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) >> at >> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) >> at >> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) >> at >> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) >> at >> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) >> at >> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) >> at >> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) >> at >> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) >> at >> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286) >> at >> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:845) >> at >> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583) >> at >> org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447) >> at java.lang.Thread.run(Thread.java:595) >> >> Kind regards, >> Francis Brouns >> >> ------------------------------------------------------------------------------ >> This SF.net email is sponsored by Sprint >> What will you do first with EVO, the first 4G phone? >> Visit sprint.com/first<http://sprint.com/first> -- >> http://p.sf.net/sfu/sprint-com-first >> _______________________________________________ >> DSpace-tech mailing list >> [email protected]<mailto:[email protected]> >> https://lists.sourceforge.net/lists/listinfo/dspace-tech >> >> >> ------------------------------------------------------------------------------ >> This SF.net email is sponsored by Sprint >> What will you do first with EVO, the first 4G phone? >> Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first >> _______________________________________________ >> DSpace-tech mailing list >> [email protected] >> https://lists.sourceforge.net/lists/listinfo/dspace-tech >> >> ------------------------------------------------------------------------------ >> The Palm PDK Hot Apps Program offers developers who use the >> Plug-In Development Kit to bring their C/C++ apps to Palm for a share >> of $1 Million in cash or HP Products. Visit us here for more details: >> http://ad.doubleclick.net/clk;226879339;13503038;l? >> http://clk.atdmt.com/CRS/go/247765532/direct/01/ >> _______________________________________________ >> DSpace-tech mailing list >> [email protected] >> https://lists.sourceforge.net/lists/listinfo/dspace-tech > > ------------------------------------------------------------------------------ > The Palm PDK Hot Apps Program offers developers who use the > Plug-In Development Kit to bring their C/C++ apps to Palm for a share > of $1 Million in cash or HP Products. Visit us here for more details: > http://ad.doubleclick.net/clk;226879339;13503038;l? > http://clk.atdmt.com/CRS/go/247765532/direct/01/ > _______________________________________________ > DSpace-tech mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/dspace-tech ------------------------------------------------------------------------------ The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://ad.doubleclick.net/clk;226879339;13503038;l? http://clk.atdmt.com/CRS/go/247765532/direct/01/ _______________________________________________ DSpace-tech mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/dspace-tech
