[Dspace-tech] Statistics in dspace 4.1
Good Morning I have problems in statistics in dspace 4.1 because their are not registering. I can see this in catalina.out java.lang.NullPointerException at org.dspace.statistics.util.SpiderDetector.isSpider(SpiderDetector.java:208) at org.dspace.statistics.util.SpiderDetector.isSpider(SpiderDetector.java:258) at org.dspace.statistics.SolrLogger.getCommonSolrDoc(SolrLogger.java:287) at org.dspace.statistics.SolrLogger.postView(SolrLogger.java:215) at org.dspace.statistics.SolrLoggerUsageEventListener.receiveEvent(SolrLoggerUsageEventListener.java:42) at org.dspace.services.events.SystemEventService.fireLocalEvent(SystemEventService.java:144) at org.dspace.services.events.SystemEventService.fireEvent(SystemEventService.java:86) at org.dspace.app.webui.servlet.BitstreamServlet.doDSGet(BitstreamServlet.java:176) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:119) at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:67) at javax.servlet.http.HttpServlet.service(HttpServlet.java:621) at javax.servlet.http.HttpServlet.service(HttpServlet.java:722) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) at org.dspace.utils.servlet.DSpaceWebappServletFilter.doFilter(DSpaceWebappServletFilter.java:78) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:927) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:987) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:307) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) java.lang.NullPointerException java.lang.NullPointerException java.lang.NullPointerException java.lang.NullPointerException java.lang.NullPointerException java.lang.NullPointerException java.lang.NullPointerException java.lang.NullPointerException java.lang.NullPointerException Any idea about this problem? Thanks for the help Best regards Antonio -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Statistics in dspace 4.1
Good MorningI Have problems in statistics in dspace 4.1 because their are not registering. I can see this in Catalina java.lang.NullPointerException at org.dspace.statistics.util.SpiderDetector.isSpider(SpiderDetector.java:208) at org.dspace.statistics.util.SpiderDetector.isSpider(SpiderDetector.java:258) at org.dspace.statistics.SolrLogger.getCommonSolrDoc(SolrLogger.java:287) at org.dspace.statistics.SolrLogger.postView(SolrLogger.java:215) at org.dspace.statistics.SolrLoggerUsageEventListener.receiveEvent(SolrLoggerUsageEventListener.java:42) at org.dspace.services.events.SystemEventService.fireLocalEvent(SystemEventService.java:144) at org.dspace.services.events.SystemEventService.fireEvent(SystemEventService.java:86) at org.dspace.app.webui.servlet.BitstreamServlet.doDSGet(BitstreamServlet.java:176) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:119) at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:67) at javax.servlet.http.HttpServlet.service(HttpServlet.java:621) at javax.servlet.http.HttpServlet.service(HttpServlet.java:722) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) at org.dspace.utils.servlet.DSpaceWebappServletFilter.doFilter(DSpaceWebappServletFilter.java:78) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:927) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:987) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:307) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) java.lang.NullPointerException java.lang.NullPointerException java.lang.NullPointerException java.lang.NullPointerException java.lang.NullPointerException java.lang.NullPointerException java.lang.NullPointerException java.lang.NullPointerException java.lang.NullPointerException Any idia about this problem? Thanksfor the help Antonio -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Statistics based on domain
Hello I have been requested by a client to provide statistics based on users domain information i.e. the number of visit counts grouped by the top level domain such as .edu, .gov, etc. I note that the 'dns' field appears to store the domain information however a number of records have an IP address stored in the statistics for the dns field rather than a domain name which would make the statistics inaccurate from a grouping perspective. I was wondering if anyone else has created similar statistics and if so, how were you able to obtain accurate information and how have you grouped the information. Any assistance would be greatly appreciated Thanks very much Anne -- One dashboard for servers and applications across Physical-Virtual-Cloud Widest out-of-the-box monitoring support with 50+ applications Performance metrics, stats and reports that give you Actionable Insights Deep dive visibility with transaction tracing using APM Insight. http://ad.doubleclick.net/ddm/clk/290420510;117567292;y___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Statistics missing in dspace 4.2
Hi, I am having a problem with the Solr statistics. I moved the statistics/data/index files from one dspace instance to another. Now it is not possible to see any data, even when I recover the original statistics/data/index files. Is there any choice to import statistics from one dspace to another (of course, both having the same content) Is there any way to regenerate or merge the statistics indexes from two dspace installations? thanks in advance, Ricardo -- RICARDO EITO BRUN Universidad Carlos III de Madrid -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Statistics missing in dspace 4.2
Hi, some remarks: The copy of SOLR indexes must be made with Tomcat stopped the version of SOLR cores must be compatible (near versions are OK) Moving SOLR statistics from one instance to another is the same procedure that the one described to migrate dspace versions (except that you actually don´t convert them) Yes, you can merge SOLR statistics. Try some tools as LUKE to merge, convert and operate indexes Best luck Emilio El 25/02/2015 a las 21:59, RICARDO EITO BRUN escribió: Hi, I am having a problem with the Solr statistics. I moved the statistics/data/index files from one dspace instance to another. Now it is not possible to see any data, even when I recover the original statistics/data/index files. Is there any choice to import statistics from one dspace to another (of course, both having the same content) Is there any way to regenerate or merge the statistics indexes from two dspace installations? thanks in advance, Ricardo -- RICARDO EITO BRUN Universidad Carlos III de Madrid -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Statistics and custom metadata reistry
Hi. I have a problem with custom metadata registry. I make a new registry local and make the element local.type. When I try to make statistics generation (stat-general or stat-initial or stat-monthly) I get an error. C:\dspacedspace stat-monthly Using DSpace installation in: C:\dspace Exception: ОШИБКА: подзапрос в выражении вернул больше одной строки org.postgresql.util.PSQLException: ОШИБКА: подзапрос в выражении вернул больше одной строки at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorI mpl.java:1531) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.ja va:1313) at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:188) at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.j ava:452) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2St atement.java:354) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2Statem ent.java:258) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingP reparedStatement.java:96) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingP reparedStatement.java:96) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingP reparedStatement.java:96) at org.dspace.storage.rdbms.DatabaseManager.query(DatabaseManager.java:284) at org.dspace.storage.rdbms.DatabaseManager.querySingle(DatabaseManager.java:33 0) at org.dspace.app.statistics.LogAnalyser.getNumItems(LogAnalyser.java:1255) at org.dspace.app.statistics.LogAnalyser.processLogs(LogAnalyser.java:498) at org.dspace.app.statistics.CreateStatReport.statMonthly(CreateStatReport.java :181) at org.dspace.app.statistics.CreateStatReport.main(CreateStatReport.java:121) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39 ) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl .java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) I think system searches all fields *.type and get 2 fields (sorry, I have Russian output in my postgres). This query works bad: SELECT COUNT(*) AS num FROM item WHERE in_archive = TRUE AND withdrawn = FALSE AND item_id IN ( SELECT item_id FROM metadatavalue WHERE metadata_field_id = ( SELECT etadata_field_id FROM metadatafieldregistry WHERE element = 'date' AND qualifier = 'accessioned') AND text_value::TIMESTAMP '2013-12-01'::TIMESTAMP AND text_value::TIMESTAMP '2013-12-31'::TIMESTAMP ) AND item_id IN ( SELECT item_id FROM metadatavalue WHERE text_value LIKE '%Thesis or Dissertation%' AND metadata_field_id = ( SELECT metadata_field_id FROM metadatafieldregistry WHERE element = 'type' AND qualifier IS NULL) ); This query works fine: SELECT COUNT(*) AS num FROM item WHERE in_archive = TRUE AND withdrawn = FALSE AND item_id IN ( SELECT item_id FROM metadatavalue WHERE metadata_field_id = ( SELECT metadata_field_id FROM metadatafieldregistry WHERE element = 'date' AND qualifier = 'accessioned') AND text_value::TIMESTAMP '2014-08-01'::TIMESTAMP AND text_value::TIMESTAMP '2014-08-31'::TIMESTAMP ) AND item_id IN ( SELECT item_id FROM metadatavalue WHERE text_value LIKE '%Thesis or Dissertation%' AND metadata_field_id = ( SELECT metadata_field_id FROM metadatafieldregistry WHERE element = 'type' AND qualifier IS NULL LIMIT 1) I have this error in 1.8.x and in 3.x versions. -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] statistics don't show countries and cities
Hi all, I'm working with dspace 4.2 and in the statistics module don't show the top country views neither top city views -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Statistics Error
Hi , Main issue is ,In the Repository ,When I click Administrative section --Statistics page ,i am getting the below message *There are currently no reports available for this service. Please check back later.* I came to know that I need to setup the cron jobs to run this ,For the cron job to run we need files such as dsrun ,stat-* files in the bin folder. I am using Dspace *3.1 * version (Linux environment). I am not able to find dsrun and stat-* files in the bin directory .I have downloaded the source files again but i am not able to find the required files. *Somehow i go the files from the different version folder.* Cron job: 0 1 * * * [dspace]/bin/stat-general 0 1 * * * [dspace]/bin/stat-monthly 0 2 * * * [dspace]/bin/stat-report-general 0 2 * * * [dspace]/bin/stat-report-monthly Now i am able to run the dsrun.bat file (but i need to specify .bat extension). Please let me know is this process correct to solve the issue ? Could i get the dsrun ans stat-* files without extension to use in my environment .I believe the files i have downloaded is not appropriate.Thanks Regards, Naveen Illinois Institute of Technology Graduate (MCS) Mob : (312) 774-1687 -- Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer http://pubads.g.doubleclick.net/gampad/clk?id=154622311iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Statistics reset after upgrade to 4.0
Hello, After upgrading from 1.8.2 to 4.0 (via 3.2), we've noticed that our item, collection, etc. statistics have been reset: they're now counting up from 0, where we previously had about a year's worth of usage. Is there anything special that needs to be done during the upgrade to retain this data? I couldn't find anything in the 4.0 documentation. Thanks very much. Best, Anthony Anthony Petryk Emerging Technologies Librarian | Bibliothécaire des technologies émergentes uOttawa Library | Bibliothèque uOttawa 613-562-5800 x4650 apet...@uottawa.camailto:apet...@uottawa.ca -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Statistics reset after upgrade to 4.0
Hi Anthony There are some big changes regarding statistics in DSpace since version 1.8.2. See: http://wiki.lib.sun.ac.za/index.php/SUNScholar/Statistics for a good starting point. Cheers hg *Hilton Gibson* Ubuntu Linux Systems Administrator JS Gericke Library Room 1025D Stellenbosch University Private Bag X5036 Stellenbosch 7599 South Africa Tel: +27 21 808 4100 | Cell: +27 84 646 4758 http://scholar.sun.ac.za http://bit.ly/goodir http://library.sun.ac.za http://za.linkedin.com/in/hiltongibson On 4 July 2014 15:37, Anthony Petryk anthony.pet...@uottawa.ca wrote: Hello, After upgrading from 1.8.2 to 4.0 (via 3.2), we’ve noticed that our item, collection, etc. statistics have been reset: they’re now counting up from 0, where we previously had about a year’s worth of usage. Is there anything special that needs to be done during the upgrade to retain this data? I couldn’t find anything in the 4.0 documentation. Thanks very much. Best, Anthony *Anthony Petryk* Emerging Technologies Librarian | Bibliothécaire des technologies émergentes uOttawa Library | Bibliothèque uOttawa 613-562-5800 x4650 apet...@uottawa.ca -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Statistics reset after upgrade to 4.0
Hi Hilton, Thanks for the link. I actually read that well before our upgrade, but I’m not seeing anything that would cause our stats to disappear. As far as I can tell, DSpace 1.8.2 uses Solr for statistics, so all the data should be there in the database. The only that that I can see that’s changed is that our Solr server used to be at http://localhost:8080/solr and now it’s at http://localhost/solr. Not sure if that makes a difference. Anthony From: Hilton Gibson [mailto:hilton.gib...@gmail.com] Sent: Friday, July 04, 2014 9:43 AM To: Anthony Petryk Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Statistics reset after upgrade to 4.0 Hi Anthony There are some big changes regarding statistics in DSpace since version 1.8.2. See: http://wiki.lib.sun.ac.za/index.php/SUNScholar/Statistics for a good starting point. Cheers hg Hilton Gibson Ubuntu Linux Systems Administrator JS Gericke Library Room 1025D Stellenbosch University Private Bag X5036 Stellenbosch 7599 South Africa Tel: +27 21 808 4100 | Cell: +27 84 646 4758 http://scholar.sun.ac.za http://bit.ly/goodir http://library.sun.ac.za http://za.linkedin.com/in/hiltongibson On 4 July 2014 15:37, Anthony Petryk anthony.pet...@uottawa.camailto:anthony.pet...@uottawa.ca wrote: Hello, After upgrading from 1.8.2 to 4.0 (via 3.2), we’ve noticed that our item, collection, etc. statistics have been reset: they’re now counting up from 0, where we previously had about a year’s worth of usage. Is there anything special that needs to be done during the upgrade to retain this data? I couldn’t find anything in the 4.0 documentation. Thanks very much. Best, Anthony Anthony Petryk Emerging Technologies Librarian | Bibliothécaire des technologies émergentes uOttawa Library | Bibliothèque uOttawa 613-562-5800 x4650 apet...@uottawa.camailto:apet...@uottawa.ca -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Statistics reset after upgrade to 4.0
Hi Anja et al, I found the problem: when upgrading, we created a new dspace home directory and didn't bring the solr/statistics/data folder over from the old one. I just copied it over manually, optimized, and it seems to have worked. Is this the right approach, or is there a better way? Thanks everyone for your help. Anthony -Original Message- From: Anja Le Blanc [mailto:anja.lebl...@manchester.ac.uk] Sent: Friday, July 04, 2014 10:28 AM To: Anthony Petryk Subject: Re: [Dspace-tech] Statistics reset after upgrade to 4.0 Hi Anthony Did you run wget http://localhost:8080/solr/statistics/update?optimize=true DSpace 4 uses a different version of Solr (lucene). Best regards, Anja -- Anja Le Blanc Jorum Team Mimas On 04/07/2014 14:37, Anthony Petryk wrote: Hello, After upgrading from 1.8.2 to 4.0 (via 3.2), we've noticed that our item, collection, etc. statistics have been reset: they're now counting up from 0, where we previously had about a year's worth of usage. Is there anything special that needs to be done during the upgrade to retain this data? I couldn't find anything in the 4.0 documentation. Thanks very much. Best, Anthony *Anthony Petryk* Emerging Technologies Librarian | Bibliothécaire des technologies émergentes uOttawa Library | Bibliothèque uOttawa 613-562-5800 x4650 apet...@uottawa.ca mailto:apet...@uottawa.ca -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Statistics (Minho or whatever)
Hi! We want to improve the statistics menu in our DSpace XMLUI (Mirage theme) website and we have seen the RepositoriUM from Minho statistics addon. The problem is that we are using DSpace 4.0 and some of the explanations of the documentation are old. Is there any way to implement that patch on the 4.0 version? If not, what solution do you have to improve the native DSpace statistics? Thank you! -- Start Your Social Network Today - Download eXo Platform Build your Enterprise Intranet with eXo Platform Software Java Based Open Source Intranet - Social, Extensible, Cloud Ready Get Started Now And Turn Your Intranet Into A Collaboration Platform http://p.sf.net/sfu/ExoPlatform___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Statistics issues - upgrading DSpace in 2 phases
On Tue, Feb 25, 2014 at 7:40 AM, Alexander Wong amd...@gmail.com wrote: Dear Helix84, Thanks for your help once again. I have gone through the update step-wise updates including the stats optimization; actually I have my DSpace 4.0 site ready on JSPUI, and I am trying to do some customization such as citation counts right now. The question lies in the later part for loading the missing parts: Do I just use dspace stats-log-covnverter + dspace stats-log-import on DSpace 4.0 to do the trick? Best Regards, Alexander Wong. Like I said, you can continue to use the legacy statistics just like you did up to now. I never used those but these are the commands to generate them from logs: https://wiki.duraspace.org/display/DSDOC4x/Command+Line+Operations#CommandLineOperations-Legacystatistics You can also use the commands you suggested to migrate to Solr statistics. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Flow-based real-time traffic analytics software. Cisco certified tool. Monitor traffic, SLAs, QoS, Medianet, WAAS etc. with NetFlow Analyzer Customize your own dashboards, set traffic alerts and generate reports. Network behavioral analysis security monitoring. All-in-one tool. http://pubads.g.doubleclick.net/gampad/clk?id=126839071iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Statistics issues - upgrading DSpace in 2 phases
On Mon, Feb 24, 2014 at 3:27 AM, Alexander Wong amd...@gmail.com wrote: 1. Capture a snapshot of DSpace 1.5 and then do all the upgrade there. I will perform all the statistical upgrade for the snapshot. All contents except for the log/stats will be frozen at then. 2. After all the upgrade is done, the snapshot will go live replacing the original production 1.5. Sounds good. If you'll be upgrading via ant update and not ant fresh_install, don't forget you need to upgrade to DSpace 3 first, run the Solr optimize command and then upgrade to DSpace 4 as described in the upgrading instructions. See the upgrading notes on upgrading over multiple versions. Check the system requirements since they will be quite different between 1.5 and 4 - especially Java, Postgres, Maven versions. I am wondering if there are any ways for me to import the differential logs/stats for the case. IIRC, in DSpace 1.5 there was only one type of statistics available - generated from log files. So it should be easy to just copy over the missing part of the log file and then generate the statistics as usual. Then if you decide to migrate to Solr stats or ES stats, the normal process applies. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Flow-based real-time traffic analytics software. Cisco certified tool. Monitor traffic, SLAs, QoS, Medianet, WAAS etc. with NetFlow Analyzer Customize your own dashboards, set traffic alerts and generate reports. Network behavioral analysis security monitoring. All-in-one tool. http://pubads.g.doubleclick.net/gampad/clk?id=126839071iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Statistics not working after upgrading Dspace
Hello, I discovered that the problem was due to the cron jobs: In order that statistical reports are generated regularly and thus kept up to date you should set up the following cron jobs: # Run stat analysis 0 1 * * * [dspace]/bin/dspace stat-general 0 1 * * * [dspace]/bin/dspace stat-monthly 0 2 * * * [dspace]/bin/dspace stat-report-general 0 2 * * * [dspace]/bin/dspace stat-report-monthly Regards, - David - .. -Mensaje original- De: David Abeijón [mailto:david.abei...@uca.es] Enviado el: viernes, 21 de febrero de 2014 12:52 Para: dspace-tech@lists.sourceforge.net Asunto: [Dspace-tech] Statistics not working after upgrading Dspace Hello, Since I upgraded our Dspace repository from v1.6.2 to 1.7.2, the statistics report is not showing information: http://web-address-to-my-dspace/xmlui/statistics; It shows the message reports not available at this moment. The weird thing is that I can see statistics for each item: http://web-address-to-my-dspace/xmlui/handle/15469/12371/statistics; and the total visits in http://web-address-to-my-dspace/xmlui/statistics-home; I tested SOLR and it is responding queries like : http://localhost:8080/solr/search/select/?q=*:*rows=0; or http://localhost:8080/solr/statistics/select?q=*:*; Any idea? Thank you, - David - .. -- Managing the Performance of Cloud-Based Applications Take advantage of what the Cloud has to offer - Avoid Common Pitfalls. Read the Whitepaper. http://pubads.g.doubleclick.net/gampad/clk?id=121054471iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Flow-based real-time traffic analytics software. Cisco certified tool. Monitor traffic, SLAs, QoS, Medianet, WAAS etc. with NetFlow Analyzer Customize your own dashboards, set traffic alerts and generate reports. Network behavioral analysis security monitoring. All-in-one tool. http://pubads.g.doubleclick.net/gampad/clk?id=126839071iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Statistics not working after upgrading Dspace
Hello, Since I upgraded our Dspace repository from v1.6.2 to 1.7.2, the statistics report is not showing information: http://web-address-to-my-dspace/xmlui/statistics; It shows the message reports not available at this moment. The weird thing is that I can see statistics for each item: http://web-address-to-my-dspace/xmlui/handle/15469/12371/statistics; and the total visits in http://web-address-to-my-dspace/xmlui/statistics-home; I tested SOLR and it is responding queries like : http://localhost:8080/solr/search/select/?q=*:*rows=0; or http://localhost:8080/solr/statistics/select?q=*:*; Any idea? Thank you, - David - .. -- Managing the Performance of Cloud-Based Applications Take advantage of what the Cloud has to offer - Avoid Common Pitfalls. Read the Whitepaper. http://pubads.g.doubleclick.net/gampad/clk?id=121054471iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] statistics in 3 xmlui
Jose, There is a default commit time/no of documents for Solr updates, this can be changed in the Solr config file. Have a look at these lines in solrconfig.xml updateHandler class=solr.DirectUpdateHandler2 !-- AutoCommit Perform a commit/ automatically under certain conditions. Instead of enabling autoCommit, consider using commitWithin when adding documents. http://wiki.apache.org/solr/UpdateXmlMessages maxDocs - Maximum number of documents to add since the last commit before automatically triggering a new commit. maxTime - Maximum amount of time that is allowed to pass since a document was added before automaticly triggering a new commit. -- !-- autoCommit maxDocs1/maxDocs maxTime1000/maxTime /autoCommit -- Regards, Ben -- Dr Ben Ryan Jorum Technical Manager 5.12 Roscoe Building The University of Manchester Oxford Road Manchester M13 9PL Tel: 0160 275 6039 E-mail: benjamin.r...@manchester.ac.uk -- -Original Message- From: Jose Blanco [mailto:blan...@umich.edu] Sent: 27 August 2013 19:32 To: Dspace-Tech Subject: Re: [Dspace-tech] statistics in 3 xmlui I just saw the numbers update, so I see there is a slight delay. On Tue, Aug 27, 2013 at 2:20 PM, Jose Blanco blan...@umich.edu wrote: I have configured stats, and I can see that collections and items are showing statistics, but when I browse around a go to different items in a collection, and clear the cache using the UI (just to make sure I don't use a cached page), and then go back to check the counts in stats page, I don't see a change. Why? Is it not suppose to be instantaneous? Thank you! Jose -- Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more! Discover the easy way to master current and previous Microsoft technologies and advance your career. Get an incredible 1,500+ hours of step-by-step tutorial videos with LearnDevNow. Subscribe today and save! http://pubads.g.doubleclick.net/gampad/clk?id=58040911iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more! Discover the easy way to master current and previous Microsoft technologies and advance your career. Get an incredible 1,500+ hours of step-by-step tutorial videos with LearnDevNow. Subscribe today and save! http://pubads.g.doubleclick.net/gampad/clk?id=58040911iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] statistics in 3 xmlui
I have configured stats, and I can see that collections and items are showing statistics, but when I browse around a go to different items in a collection, and clear the cache using the UI (just to make sure I don't use a cached page), and then go back to check the counts in stats page, I don't see a change. Why? Is it not suppose to be instantaneous? Thank you! Jose -- Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more! Discover the easy way to master current and previous Microsoft technologies and advance your career. Get an incredible 1,500+ hours of step-by-step tutorial videos with LearnDevNow. Subscribe today and save! http://pubads.g.doubleclick.net/gampad/clk?id=58040911iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] statistics in 3 xmlui
I just saw the numbers update, so I see there is a slight delay. On Tue, Aug 27, 2013 at 2:20 PM, Jose Blanco blan...@umich.edu wrote: I have configured stats, and I can see that collections and items are showing statistics, but when I browse around a go to different items in a collection, and clear the cache using the UI (just to make sure I don't use a cached page), and then go back to check the counts in stats page, I don't see a change. Why? Is it not suppose to be instantaneous? Thank you! Jose -- Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more! Discover the easy way to master current and previous Microsoft technologies and advance your career. Get an incredible 1,500+ hours of step-by-step tutorial videos with LearnDevNow. Subscribe today and save! http://pubads.g.doubleclick.net/gampad/clk?id=58040911iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Statistics - top country and city view on comm. coll. page
Hello, do you have any idea about this ??? On Mon, Jul 8, 2013 at 11:53 PM, Abhishek Raval abhis...@webinito.comwrote: Hello All, I m using Dspace -1.7.2 (JSPUI) . When I press button view statistics on community collection page, there is no statistics report which ll show me Top 10 country from where the visits originate Top 10 cities from where the visits originate Top 10 most popular items I have file [dspace]/config/GeoLiteCity.dat ,,,still problem is there -- Thanks n Regards Abhishek Raval Software Engg. Webinito Networks Ph no.-+919601077584 -- See everything from the browser to the database with AppDynamics Get end-to-end visibility with application monitoring from AppDynamics Isolate bottlenecks and diagnose root cause in seconds. Start your free trial of AppDynamics Pro today! http://pubads.g.doubleclick.net/gampad/clk?id=48808831iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Statistics - top country and city view on comm. coll. page
Are you running cron jobs? https://wiki.duraspace.org/display/DSDOC18/Installation#Installation-'cron'Jobs Javier Távara 2013/7/18 Abhishek Raval abhis...@webinito.com Hello, do you have any idea about this ??? On Mon, Jul 8, 2013 at 11:53 PM, Abhishek Raval abhis...@webinito.comwrote: Hello All, I m using Dspace -1.7.2 (JSPUI) . When I press button view statistics on community collection page, there is no statistics report which ll show me Top 10 country from where the visits originate Top 10 cities from where the visits originate Top 10 most popular items I have file [dspace]/config/GeoLiteCity.dat ,,,still problem is there -- Thanks n Regards Abhishek Raval Software Engg. Webinito Networks Ph no.-+919601077584 -- See everything from the browser to the database with AppDynamics Get end-to-end visibility with application monitoring from AppDynamics Isolate bottlenecks and diagnose root cause in seconds. Start your free trial of AppDynamics Pro today! http://pubads.g.doubleclick.net/gampad/clk?id=48808831iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- See everything from the browser to the database with AppDynamics Get end-to-end visibility with application monitoring from AppDynamics Isolate bottlenecks and diagnose root cause in seconds. Start your free trial of AppDynamics Pro today! http://pubads.g.doubleclick.net/gampad/clk?id=48808831iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Statistics - top country and city view on comm. coll. page
I was having this problem as well. Do you have a proxy in front of dspace? If you do, you have to set useProxies=true in dspace.cfg in order to get the client's ip from x-forwarded-for property. Ats, Alcides Carlos de Moraes Neto It is dangerous to be right when the government is wrong. -Voltaire 2013/7/8 Abhishek Raval abhis...@webinito.com Hello All, I m using Dspace -1.7.2 (JSPUI) . When I press button view statistics on community collection page, there is no statistics report which ll show me Top 10 country from where the visits originate Top 10 cities from where the visits originate Top 10 most popular items I have file [dspace]/config/GeoLiteCity.dat ,,,still problem is there -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- See everything from the browser to the database with AppDynamics Get end-to-end visibility with application monitoring from AppDynamics Isolate bottlenecks and diagnose root cause in seconds. Start your free trial of AppDynamics Pro today! http://pubads.g.doubleclick.net/gampad/clk?id=48808831iu=/4140/ostg.clktrk___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Statistics - top country and city view on comm. coll. page
Hello All, I m using Dspace -1.7.2 (JSPUI) . When I press button view statistics on community collection page, there is no statistics report which ll show me Top 10 country from where the visits originate Top 10 cities from where the visits originate Top 10 most popular items I have file [dspace]/config/GeoLiteCity.dat ,,,still problem is there -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Statistics start-up problems
Hi: I've installed DSpace 3.1 (xmlui) on an XP workstation here, for testing. Generally, things seem to be working well, and customization of the user interface has been straightforward. However, I'm stymied by the statistics. Here is what I'm getting -- View Usage Statistics : No results, blank page (with menus). View Search Statistics : There was an error while generating the search statistics, please try again later. View Workflow Statistics : There was an error while generating the search statistics, please try again later. Here's what I get when I run [dspace]/bin dspace stats-util -b -r Using DSpace installation in: C:\dspace Exception: Error executing query org.apache.solr.client.solrj.SolrServerException: Error executing query at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:95) at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:118) at org.dspace.statistics.SolrLogger.reindexBitstreamHits(SolrLogger.java:1286) at org.dspace.statistics.util.StatisticsClient.main(StatisticsClient.java:97) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) Caused by: org.apache.solr.common.SolrException: Bad Request Bad Request request: http://127.0.0.1:8080/solr/statistics/select?q=*:*fq=type:0fq=-bundle Name:[* TO *]rows=0shards=127.0.0.1:8080/solr/statisticswt=javabinversion=2 at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(Commo nsHttpSolrServer.java:435) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(Commo nsHttpSolrServer.java:244) at org.apache.solr.client.solrj.request.QueryRequest.process(QueryReques t.java:89) ... 8 more Any idea what is going wrong? I have attached a copy of the dspace log file. Gord 2013-06-26 10:44:04,128 INFO net.sf.ehcache.util.UpdateChecker @ New update(s) found: 2.4.7 [http://www.terracotta.org/confluence/display/release/Release+Notes+Ehcache+Core+2.4] 2013-06-26 10:44:30,487 INFO org.dspace.app.xmlui.configuration.XMLUIConfiguration @ Loading XMLUI configuration from: c:/dspace\config\xmlui.xconf 2013-06-26 10:44:30,940 INFO org.dspace.app.xmlui.configuration.XMLUIConfiguration @ Aspect Installed: name='Displaying Artifacts', path='resource://aspects/ViewArtifacts/'. 2013-06-26 10:44:30,940 INFO org.dspace.app.xmlui.configuration.XMLUIConfiguration @ Aspect Installed: name='Browsing Artifacts', path='resource://aspects/BrowseArtifacts/'. 2013-06-26 10:44:30,940 INFO org.dspace.app.xmlui.configuration.XMLUIConfiguration @ Aspect Installed: name='Searching Artifacts', path='resource://aspects/SearchArtifacts/'. 2013-06-26 10:44:30,940 INFO org.dspace.app.xmlui.configuration.XMLUIConfiguration @ Aspect Installed: name='Administration', path='resource://aspects/Administrative/'. 2013-06-26 10:44:30,940 INFO org.dspace.app.xmlui.configuration.XMLUIConfiguration @ Aspect Installed: name='E-Person', path='resource://aspects/EPerson/'. 2013-06-26 10:44:30,940 INFO org.dspace.app.xmlui.configuration.XMLUIConfiguration @ Aspect Installed: name='Submission and Workflow', path='resource://aspects/Submission/'. 2013-06-26 10:44:30,940 INFO org.dspace.app.xmlui.configuration.XMLUIConfiguration @ Aspect Installed: name='Statistics', path='resource://aspects/Statistics/'. 2013-06-26 10:44:30,940 INFO org.dspace.app.xmlui.configuration.XMLUIConfiguration @ Aspect Installed: name='Original Workflow', path='resource://aspects/Workflow/'. 2013-06-26 10:44:30,956 INFO org.dspace.app.xmlui.configuration.XMLUIConfiguration @ Theme Installed: name='Atmire Mirage Theme', path='Mirage/', id='null', regex='.*', handle='null'. 2013-06-26 10:44:31,706 INFO net.sf.ehcache.util.UpdateChecker @ New update(s) found: 2.4.7 [http://www.terracotta.org/confluence/display/release/Release+Notes+Ehcache+Core+2.4] 2013-06-26 10:44:31,722 INFO net.sf.ehcache.util.UpdateChecker @ New update(s) found: 2.4.7 [http://www.terracotta.org/confluence/display/release/Release+Notes+Ehcache+Core+2.4] 2013-06-26 10:44:39,019 INFO org.dspace.app.xmlui.aspect.artifactbrowser.CommunityBrowser @ anonymous:session_id=1DD9C9379C3FA272C452E2CB889E8495:ip_addr=204.225.10.214:view_community_list: 2013-06-26 10:44:52,112 INFO org.dspace.authenticate.PasswordAuthentication @ anonymous:session_id=1DD9C9379C3FA272C452E2CB889E8495:ip_addr=204.225.10.214:authenticate:attempting password auth of user=grip...@trentu.ca 2013-06-26 10:44:52,190 INFO org.dspace.authenticate.PasswordAuthentication @ grip...@trentu.ca:session_id=1DD9C9379C3FA272C452E2CB889E8495:ip_addr=204.225.10.214:authenticate:type=PasswordAuthentication
[Dspace-tech] Statistics start-up problems
Hi: I've installed DSpace 3.1 (xmlui) on an XP workstation here, for testing. Generally, things seem to be working well, and customization of the user interface has been straightforward. However, I'm stymied by the statistics. Here is what I'm getting -- View Usage Statistics : No results, blank page (with menus). View Search Statistics : There was an error while generating the search statistics, please try again later. View Workflow Statistics : There was an error while generating the search statistics, please try again later. I'm new to DSpace, so I've been over the documentation pretty carefully. It makes sense to me that I would need to run some batch jobs to prepare statistics, but none of these appear in the 3.1 /bin folder: [dspace]/bin/sub-daily [dspace]/bin/filter-media [dspace]/bin/checker -lp [dspace]/bin/dsrun org.dspace.checker.DailyReportEmailer -c [dspace]/bin/stat-general [dspace]/bin/stat-monthly [dspace]/bin/stat-report-general [dspace]/bin/stat-report-monthly I can query solr directly, so it would seem to be in the right place and configured properly. Is this something very simple that I am overlooking ... or is it a Windows issue? Gord * * * * * * * * * * * * * * * * * * * * * Gord Ripley, Research and Development Librarian, Bata Library, Trent University, 1600 West Bank Drive, Peterborough, Ontario K9J 7B8 Voice : 705- 748-1011 ext. 7517 E-mail : grip...@trentu.ca Web : http://people.trentu.ca/gripley/ * * * * * * * * * * * * * * * * * * * * * -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Statistics start-up problems
Hi, Do you read http://wiki.lib.sun.ac.za/index.php/SUNScholar/Daily_Admin? In special: @daily /home/dspace/bin/dspace stats-util -b -r @weekly /home/dspace/bin/dspace stats-util -o @monthly/home/dspace/bin/dspace stats-util -u -m -i -f On Tue, Jun 25, 2013 at 5:40 PM, Gord Ripley grip...@trentu.ca wrote: Hi: I've installed DSpace 3.1 (xmlui) on an XP workstation here, for testing. Generally, things seem to be working well, and customization of the user interface has been straightforward. However, I'm stymied by the statistics. Here is what I'm getting -- View Usage Statistics : No results, blank page (with menus). View Search Statistics : There was an error while generating the search statistics, please try again later. View Workflow Statistics : There was an error while generating the search statistics, please try again later. I'm new to DSpace, so I've been over the documentation pretty carefully. It makes sense to me that I would need to run some batch jobs to prepare statistics, but none of these appear in the 3.1 /bin folder: [dspace]/bin/sub-daily [dspace]/bin/filter-media [dspace]/bin/checker -lp [dspace]/bin/dsrun org.dspace.checker.DailyReportEmailer -c [dspace]/bin/stat-general [dspace]/bin/stat-monthly [dspace]/bin/stat-report-general [dspace]/bin/stat-report-monthly I can query solr directly, so it would seem to be in the right place and configured properly. Is this something very simple that I am overlooking ... or is it a Windows issue? Gord * * * * * * * * * * * * * * * * * * * * * Gord Ripley, Research and Development Librarian, Bata Library, Trent University, 1600 West Bank Drive, Peterborough, Ontario K9J 7B8 Voice : 705- 748-1011 ext. 7517 E-mail : grip...@trentu.ca Web : http://people.trentu.ca/gripley/ * * * * * * * * * * * * * * * * * * * * * -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Statistics in DSpace from version 1.7 -- 1.8 -- 3.0
Hi, Can someone tell me if the Statistics package in DSpace has changed from version 1.7 (integration with SOLR) to 1.8 and 3.0, or is it basically the same? Thanks in advance. Best regards, Sue Walker-Thornton Sue Walker-Thornton Software Developer/Database Administrator NASA Langley Research Center - LITES Contract susan.m.thorn...@nasa.gov (W) 757-864-2368 (M) 757-506-9903 -- Try New Relic Now We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] statistics null
Hi all, I have a problem with my repository statistics. When I access my statistics appear visits and downloads of all the months and years except for two months (October and November). Why this error may have occurred? What files DSpace collects statistical information for display? Should we update the Solr module? Thanks to all. -- View this message in context: http://dspace.2283337.n4.nabble.com/statistics-null-tp4660803.html Sent from the DSpace - Tech mailing list archive at Nabble.com. -- Master SQL Server Development, Administration, T-SQL, SSAS, SSIS, SSRS and more. Get SQL Server skills now (including 2012) with LearnDevNow - 200+ hours of step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only - learn more at: http://p.sf.net/sfu/learnmore_122512 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] statistics null
On Tue, Jan 8, 2013 at 12:16 PM, cotanio cota...@gmail.com wrote: I have a problem with my repository statistics. When I access my statistics appear visits and downloads of all the months and years except for two months (October and November). Why this error may have occurred? What files DSpace collects statistical information for display? Should we update the Solr module? Hi Cotanio, I don't know why it happened to you that two months are missing. But if you still have the log files from that period around ([dspace]/log/dspace.log.2011-10-*, [dspace]/log/dspace.log.2011-11-*), you can use the stats-log-converter / stats-log-importer scripts to import these statistics to Solr. Upgrading Solr surely won't help and I would recommend against it (it's not as easy as it sounds and it will break stuff). Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Master SQL Server Development, Administration, T-SQL, SSAS, SSIS, SSRS and more. Get SQL Server skills now (including 2012) with LearnDevNow - 200+ hours of step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only - learn more at: http://p.sf.net/sfu/learnmore_122512 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Statistics question
On Thu, Dec 13, 2012 at 9:52 PM, Andrea Schweer schw...@waikato.ac.nz wrote: Jira issue pull request done -- I was just waiting for feedback from Ian. Thanks for your comments, Ian! https://jira.duraspace.org/browse/DS-1426 https://github.com/DSpace/DSpace/pull/157 Thanks! The pull request is against master; I can make a new one against dspace-3_x if that helps. No need, I cherry-picked it instead. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial Remotely access PCs and mobile devices and provide instant support Improve your efficiency, and focus on delivering more value-add services Discover what IT Professionals Know. Rescue delivers http://p.sf.net/sfu/logmein_12329d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Statistics question
Hi Andrea, Just a friendly request -- if this fix helps with performance for both you Ian, would you be willing to submit a Pull Request? I'd like to see this get into DSpace 3.1 as a bug fix, if it's a worthwhile improvement to the performance of stats logging. Thanks, - Tim On 12/12/2012 11:41 PM, Ian Boston wrote: (resending due to a list bounce, Andrea you will have got this already, no need to read twice :)) On 13 December 2012 13:53, Andrea Schweer schw...@waikato.ac.nz wrote: Hi, On 13/12/12 15:33, Andrea Schweer wrote: On 13/12/12 15:20, Ian Boston wrote: UsageActionLogger.act consumes 2/3 of the time spent in the request and all of that is in SolrLogger.storeParents If I remember right then I have a local customisation somewhere that eliminates this. I'll check whether I can find it and will get back to you. Here you go: https://github.com/aschweer/DSpace/commit/de80eb6545fbfc411a37c901de7a8ed856ff735e -- this is against master; I've only tested it with 1.8.2. Does this help improve performance? Andrea, Yes makes a difference, not quite as much as removing the actions from the sitemap, but certainly better than the default. I think I will see if we can gather stats in a different way, perhaps by post processing logs as recording stats in this way means that the cocoon pipelines can't be cached. Ian cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial Remotely access PCs and mobile devices and provide instant support Improve your efficiency, and focus on delivering more value-add services Discover what IT Professionals Know. Rescue delivers http://p.sf.net/sfu/logmein_12329d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial Remotely access PCs and mobile devices and provide instant support Improve your efficiency, and focus on delivering more value-add services Discover what IT Professionals Know. Rescue delivers http://p.sf.net/sfu/logmein_12329d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial Remotely access PCs and mobile devices and provide instant support Improve your efficiency, and focus on delivering more value-add services Discover what IT Professionals Know. Rescue delivers http://p.sf.net/sfu/logmein_12329d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Statistics question
Hi Tim, On 14/12/12 04:23, Tim Donohue wrote: Just a friendly request -- if this fix helps with performance for both you Ian, would you be willing to submit a Pull Request? I'd like to see this get into DSpace 3.1 as a bug fix, if it's a worthwhile improvement to the performance of stats logging. Jira issue pull request done -- I was just waiting for feedback from Ian. Thanks for your comments, Ian! https://jira.duraspace.org/browse/DS-1426 https://github.com/DSpace/DSpace/pull/157 The pull request is against master; I can make a new one against dspace-3_x if that helps. cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial Remotely access PCs and mobile devices and provide instant support Improve your efficiency, and focus on delivering more value-add services Discover what IT Professionals Know. Rescue delivers http://p.sf.net/sfu/logmein_12329d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Statistics question
Hi, I have been doing some load testing on the development version of DSpace3 here at Cambridge. (Actually I am doing it from Sydney where I am based, but thats another story). I've done some reasonable extensive JMeter load tests all of which seem to point to quite slow performance for a web application. But I can illustrate quickly with just Apache Benchmark. First off, if I use Apache Benchmark on our live system running jspui to fetch an item page with: ab -k -c10 -n100 http://www.dspace.cam.ac.uk/handle/1810/244032 I get Requests per second:7.60 [#/sec] (mean) Time per request: 1949.402 [ms] (mean) The instance is DSpace 1.6 and unloaded other than the quick test. No one has been complaining about the live instance and many are saying its quite nippy even if the figures say otherwise. If I do the the same against the new DSpace3 instance with no local modifications other than I skinning I get. Requests per second:13.73 [#/sec] (mean) Time per request: 728.264 [ms] (mean) If I do the same for a custom thumbnail servlet using the DSpace3 API I get with caching in the Apache Httpd fron end turned off Requests per second:873.10 [#/sec] (mean) Time per request: 11.454 [ms] (mean) If I turn caching on ant let the httpd front end deal with the request I get Requests per second:17525.41 [#/sec] (mean) Time per request: 0.571 [ms] (mean) If I attached profiler and look into exactly what is happening. 1 request with the profiler connected takes 970ms Some observations: The statement cleanup from the SQL connection pool is about the most expensive operation at 110ms for 57 invocations. To build the page takes 57 SQL queries, although none are expensive. (all bar 3 report 1ms). UsageActionLogger.act consumes 2/3 of the time spent in the request and all of that is in SolrLogger.storeParents Is 20 request / s with a 10 concurrent request threads normal for DSpace ? Is anyone running DSpace with a Apache Httpd front end with mod_cache enabled, presumably forging statistics ? Any insights would be helpful so I can advise the team here on what to do. This is important to us as we are expecting an increase in usage of the service due to the UK open access agenda and I need to get performance up to more typical levels for anon users. (ie 2K pages/s). Authenticated users are ok with the current performance. Sorry for the long email. Ian -- LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial Remotely access PCs and mobile devices and provide instant support Improve your efficiency, and focus on delivering more value-add services Discover what IT Professionals Know. Rescue delivers http://p.sf.net/sfu/logmein_12329d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Statistics question
Hi Ian, I have input only for a very small part of your e-mail: On 13/12/12 15:20, Ian Boston wrote: UsageActionLogger.act consumes 2/3 of the time spent in the request and all of that is in SolrLogger.storeParents If I remember right then I have a local customisation somewhere that eliminates this. I'll check whether I can find it and will get back to you. cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial Remotely access PCs and mobile devices and provide instant support Improve your efficiency, and focus on delivering more value-add services Discover what IT Professionals Know. Rescue delivers http://p.sf.net/sfu/logmein_12329d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Statistics question
Hi, On 13/12/12 15:33, Andrea Schweer wrote: On 13/12/12 15:20, Ian Boston wrote: UsageActionLogger.act consumes 2/3 of the time spent in the request and all of that is in SolrLogger.storeParents If I remember right then I have a local customisation somewhere that eliminates this. I'll check whether I can find it and will get back to you. Here you go: https://github.com/aschweer/DSpace/commit/de80eb6545fbfc411a37c901de7a8ed856ff735e -- this is against master; I've only tested it with 1.8.2. Does this help improve performance? cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial Remotely access PCs and mobile devices and provide instant support Improve your efficiency, and focus on delivering more value-add services Discover what IT Professionals Know. Rescue delivers http://p.sf.net/sfu/logmein_12329d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Statistics question
(resending due to a list bounce, Andrea you will have got this already, no need to read twice :)) On 13 December 2012 13:53, Andrea Schweer schw...@waikato.ac.nz wrote: Hi, On 13/12/12 15:33, Andrea Schweer wrote: On 13/12/12 15:20, Ian Boston wrote: UsageActionLogger.act consumes 2/3 of the time spent in the request and all of that is in SolrLogger.storeParents If I remember right then I have a local customisation somewhere that eliminates this. I'll check whether I can find it and will get back to you. Here you go: https://github.com/aschweer/DSpace/commit/de80eb6545fbfc411a37c901de7a8ed856ff735e -- this is against master; I've only tested it with 1.8.2. Does this help improve performance? Andrea, Yes makes a difference, not quite as much as removing the actions from the sitemap, but certainly better than the default. I think I will see if we can gather stats in a different way, perhaps by post processing logs as recording stats in this way means that the cocoon pipelines can't be cached. Ian cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial Remotely access PCs and mobile devices and provide instant support Improve your efficiency, and focus on delivering more value-add services Discover what IT Professionals Know. Rescue delivers http://p.sf.net/sfu/logmein_12329d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial Remotely access PCs and mobile devices and provide instant support Improve your efficiency, and focus on delivering more value-add services Discover what IT Professionals Know. Rescue delivers http://p.sf.net/sfu/logmein_12329d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] statistics spiders list
Hello helix84 Yes, we'd be happy to share the code that @mire developed. And, we would like to get this functionality into a future release of DSpace as a configurable 'out-of-the-box' option. If it's ok with you, I'll contact you again - off-list - to discuss in more detail? Cheers Paul -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: 15 November 2012 11:43 To: Needham, Paul Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] statistics spiders list Paul, that is some interesting work there! Central collection via OpenURL, with deduplication and elimination of robots. I didn't know about it because I wasn't at OR12. Do you have any code available? Are you planning to submit something for DSpace 4.0? There's a lot of interesting things happening in statistics these days. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] statistics spiders list
On Fri, Nov 16, 2012 at 4:13 PM, Needham, Paul p.a.need...@cranfield.ac.uk wrote: Yes, we'd be happy to share the code that @mire developed. And, we would like to get this functionality into a future release of DSpace as a configurable 'out-of-the-box' option. If it's ok with you, I'll contact you again - off-list - to discuss in more detail? Sure, that would be great. But right now we're busy with finishing the 3.0 release, so I don't work on new stuff. Please, contact me after we release 3.0, which is curently planned for the end of this month. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] statistics spiders list
This directly relates to the the following item in JIRA: API for exchange of Usage Data over OAI-PMH or SUSHI https://jira.duraspace.org/browse/DS-626 -- [image: logo] *Bram Luyten* *@mire* *2888 Loker Avenue East, Suite 315, Carlsbad, CA. 92010* *Esperantolaan 4, Heverlee 3001, Belgium* http://www.atmire.com/www.atmire.comhttp://atmire.com/website/?q=servicesutm_source=emailfooterutm_medium=emailutm_campaign=braml On Fri, Nov 16, 2012 at 4:50 PM, helix84 heli...@centrum.sk wrote: On Fri, Nov 16, 2012 at 4:13 PM, Needham, Paul p.a.need...@cranfield.ac.uk wrote: Yes, we'd be happy to share the code that @mire developed. And, we would like to get this functionality into a future release of DSpace as a configurable 'out-of-the-box' option. If it's ok with you, I'll contact you again - off-list - to discuss in more detail? Sure, that would be great. But right now we're busy with finishing the 3.0 release, so I don't work on new stuff. Please, contact me after we release 3.0, which is curently planned for the end of this month. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] statistics spiders list
On Fri, Nov 16, 2012 at 4:56 PM, Bram Luyten b...@mire.be wrote: This directly relates to the the following item in JIRA: API for exchange of Usage Data over OAI-PMH or SUSHI https://jira.duraspace.org/browse/DS-626 Thanks for noting that, Bram. Paul, it would be best if you used the time before the release to coordinate with people participating in that ticket's discussion and were able to agree upon a common implementation (because there seem to be 4, including yours). That would be much much easier to accept. I think the people from the RCAAP project are definitely worth getting in touch with because they have a large number of participating repositories. I don't know about the Germans and Belgians. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] statistics spiders list
Hi folks You may be interested in the work of IRUS-UK, a developing service which consolidates COUNTER-compliant statistics to enable repositories to benchmark their usage against other repositories in the UK. IRUS-UK is filtering out robots and spiders employing the UserAgent-based COUNTER robots exclusion list (http://www.projectcounter.org/documents/COUNTER_robot_txt_list_Jan_2011.txt which is mentioned in https://jira.duraspace.org/browse/DS-790). For DSpace 1.8.x repositories, we're using patches developed by @mire. IRUS-UK follows on from the very successful PIRUS2 project, which demonstrated how article-level (COUNTER-compliant) usage statistics could be collected, JISC have provided funding to take forward the UK Institutional Repository aspects in the form of IRUS-UK. IRUS-UK is a wave 1 component of UK RepositoryNet+, the JISC funded repository and infrastructure service. IRUS is currently funded to establish a national aggregation service. It will ultimately contain details of all material downloaded from participating IRs, including downloads for full-text articles, theses, conference papers, technical reports, etc. IRUS will help to demonstrate the value and impact of institutional repositories and provide an evidence base for repositories to develop policies and initiatives to help support their objectives. IRUS-UK is being developed by a consortium involving Mimas at The University of Manchester, Cranfield University and Evidence Base at Birmingham City University. You can find our more by visiting our website which is available at http://www.irus.mimas.ac.uk. You are welcome to get in touch at i...@mimas.ac.uk if you would like further information. Cheers Paul _ Paul A S Needham Research Innovation Manager Kings Norton Library Cranfield University Cranfield MK43 0AL -Original Message- From: helix84 [mailto:heli...@centrum.sk] Sent: 14 November 2012 15:21 To: Ben Sheaff Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] statistics spiders list Hi Ben, it might be helpful for you to read and watch this issue: https://jira.duraspace.org/browse/DS-790 Regards, ~~helix84 -Original Message- From: helix84 [mailto:heli...@centrum.sk] Sent: 07 November 2012 17:11 To: Ben Sheaff Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] statistics spiders list On Wed, Nov 7, 2012 at 5:58 PM, Ben Sheaff bshe...@uvic.ca wrote: I am wonder if anyone has put together a good list of bots and spiders for solr statistics. It seems that the default ones being provided by http://iplists.com are not being updated. I don't believe you'll find a better one in the format DSpace takes by default. But it wouldn't hurt to listen to the advice given elsewhere on the web when this question is asked - detect user agent strings instead of particular IPs (which may change in time). Of course, you'd need to modify DSpace to do that. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- LogMeIn Central: Instant, anywhere, Remote PC access and management. Stay in control, update software, and manage PCs from one command center Diagnose problems and improve visibility into emerging IT issues Automate, monitor and manage. Do more in less time with Central http://p.sf.net/sfu/logmein12331_d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] statistics spiders list
Paul, that is some interesting work there! Central collection via OpenURL, with deduplication and elimination of robots. I didn't know about it because I wasn't at OR12. Do you have any code available? Are you planning to submit something for DSpace 4.0? There's a lot of interesting things happening in statistics these days. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] statistics spiders list
Folk might be interested in a talk from Ross MacIntyre recorded last week in Middlesbrough: http://ukcorr.org/2012/11/14/irus-uk-usage-stats-and-repositories/ Nick Sent from my HTC - Reply message - From: helix84 heli...@centrum.sk To: Needham, Paul p.a.need...@cranfield.ac.uk Cc: dspace-tech@lists.sourceforge.net dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] statistics spiders list Date: Thu, Nov 15, 2012 11:46 am Paul, that is some interesting work there! Central collection via OpenURL, with deduplication and elimination of robots. I didn't know about it because I wasn't at OR12. Do you have any code available? Are you planning to submit something for DSpace 4.0? There's a lot of interesting things happening in statistics these days. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech To view the terms under which this email is distributed, please go to http://disclaimer.leedsmet.ac.uk/email.htm -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] statistics spiders list
Hi Ben, it might be helpful for you to read and watch this issue: https://jira.duraspace.org/browse/DS-790 Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Monitor your physical, virtual and cloud infrastructure from a single web console. Get in-depth insight into apps, servers, databases, vmware, SAP, cloud infrastructure, etc. Download 30-day Free Trial. Pricing starts from $795 for 25 servers or applications! http://p.sf.net/sfu/zoho_dev2dev_nov ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] statistics spiders list
Hello, I am wonder if anyone has put together a good list of bots and spiders for solr statistics. It seems that the default ones being provided by http://iplists.com are not being updated. The list can be found in dspace.cfg under: solr.spiderips.urls -- LogMeIn Central: Instant, anywhere, Remote PC access and management. Stay in control, update software, and manage PCs from one command center Diagnose problems and improve visibility into emerging IT issues Automate, monitor and manage. Do more in less time with Central http://p.sf.net/sfu/logmein12331_d2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] statistics spiders list
On Wed, Nov 7, 2012 at 5:58 PM, Ben Sheaff bshe...@uvic.ca wrote: I am wonder if anyone has put together a good list of bots and spiders for solr statistics. It seems that the default ones being provided by http://iplists.com are not being updated. I don't believe you'll find a better one in the format DSpace takes by default. But it wouldn't hurt to listen to the advice given elsewhere on the web when this question is asked - detect user agent strings instead of particular IPs (which may change in time). Of course, you'd need to modify DSpace to do that. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- LogMeIn Central: Instant, anywhere, Remote PC access and management. Stay in control, update software, and manage PCs from one command center Diagnose problems and improve visibility into emerging IT issues Automate, monitor and manage. Do more in less time with Central http://p.sf.net/sfu/logmein12331_d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics
Hello, The statistics goes only 6 months back, but I would like to increase it to 18 months. Can anybody tell me how to do that? I run DSpace 1.8.2 on a Fedora 16 server. The interface is a modified version of the REFERENCE theme in XMLUI. Thank you for your time. Alain Tschanz -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics
Hi Alain, I hope this works for you: https://wiki.duraspace.org/display/DSDOC3x/DSpace+Statistics#DSpaceStatistics-WebUIStatisticsModification(XMLUIOnly) Or in short, change -6 in this line to whatever you want: https://github.com/DSpace/DSpace/blob/dspace-1_8_x/dspace-xmlui/dspace-xmlui-api/src/main/java/org/dspace/app/xmlui/aspect/statistics/StatisticsTransformer.java#L178 best regards, Bram -- [image: logo] *Bram Luyten* *@mire* *2888 Loker Avenue East, Suite 315, Carlsbad, CA. 92010* *Esperantolaan 4, Heverlee 3001, Belgium* http://www.atmire.com/www.atmire.comhttp://atmire.com/website/?q=servicesutm_source=emailfooterutm_medium=emailutm_campaign=braml On Wed, Oct 3, 2012 at 3:32 PM, Alain Tschanz atsch...@njstatelib.orgwrote: Hello, The statistics goes only 6 months back, but I would like to increase it to 18 months. Can anybody tell me how to do that? ** ** I run DSpace 1.8.2 on a Fedora 16 server. The interface is a modified version of the REFERENCE theme in XMLUI. ** ** Thank you for your time. ** ** Alain Tschanz ** ** -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics
Thank you for your response. I changed the number from -6 to -18 and recompiled the code but the statistics page still only displays 6 months of data. Any ideas why? Alain From: bluy...@gmail.com [mailto:bluy...@gmail.com] On Behalf Of Bram Luyten Sent: Wednesday, October 3, 2012 12:55 PM To: Alain Tschanz Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] Statistics Hi Alain, I hope this works for you: https://wiki.duraspace.org/display/DSDOC3x/DSpace+Statistics#DSpaceStatistics-WebUIStatisticsModification(XMLUIOnly) Or in short, change -6 in this line to whatever you want: https://github.com/DSpace/DSpace/blob/dspace-1_8_x/dspace-xmlui/dspace-xmlui-api/src/main/java/org/dspace/app/xmlui/aspect/statistics/StatisticsTransformer.java#L178 best regards, Bram -- [logo] Bram Luyten @mire 2888 Loker Avenue East, Suite 315, Carlsbad, CA. 92010 Esperantolaan 4, Heverlee 3001, Belgium http://www.atmire.com/ www.atmire.comhttp://atmire.com/website/?q=servicesutm_source=emailfooterutm_medium=emailutm_campaign=braml On Wed, Oct 3, 2012 at 3:32 PM, Alain Tschanz atsch...@njstatelib.orgmailto:atsch...@njstatelib.org wrote: Hello, The statistics goes only 6 months back, but I would like to increase it to 18 months. Can anybody tell me how to do that? I run DSpace 1.8.2 on a Fedora 16 server. The interface is a modified version of the REFERENCE theme in XMLUI. Thank you for your time. Alain Tschanz -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.netmailto:DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics
Hello, I'm trying to write a statistics report that aggregates the numbers of a community X and all its sub-communities and that shows the numbers for each sub-community. Like this: Community X: 2000 views Sub-communityA of community X: 500 views Sub-communityB of community X: 500 views Sub-communityC of community X: 500 views Sub-communityD of community X: 500 views Thank you. Alain Tschanz -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics report on Community and Collection Page
Hi: Do you get an error page or blank page?. If you get a blank page, with your Dspace template (skin or layout), you should check your solr config and test the connection with it. I'd this error before I know the solr stats module. If you get an error page, check your logs (dspace and web server) Regards El 17/04/2012 02:04, Abhishek Raval abhis...@webinito.com escribió: Hello All, Wen i m going to click on View Statistics button on Community n Collection page i didnt get any report for this. Wat to do -- Thanks n Regards Abhishek Raval Ph no.-+919601077584 -- Better than sec? Nothing is better than sec when it comes to monitoring Big Data applications. Try Boundary one-second resolution app monitoring today. Free. http://p.sf.net/sfu/Boundary-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Better than sec? Nothing is better than sec when it comes to monitoring Big Data applications. Try Boundary one-second resolution app monitoring today. Free. http://p.sf.net/sfu/Boundary-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics report on Community and Collection Page
Hello All, Wen i m going to click on View Statistics button on Community n Collection page i didnt get any report for this. Wat to do -- Thanks n Regards Abhishek Raval Ph no.-+919601077584 -- Better than sec? Nothing is better than sec when it comes to monitoring Big Data applications. Try Boundary one-second resolution app monitoring today. Free. http://p.sf.net/sfu/Boundary-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics: Collection sizes
Is there a way to get size statistics (disc space, number of items, number of objects, etc) per collection in DSpace? Paul Go Systems Librarian / Library Technology Manager Paul V. Galvin Library 35 West 33rd Street Chicago, IL 60616 312.567.7997 p...@iit.edu -- Better than sec? Nothing is better than sec when it comes to monitoring Big Data applications. Try Boundary one-second resolution app monitoring today. Free. http://p.sf.net/sfu/Boundary-dev2dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics: Collection sizes
On Wed, Apr 4, 2012 at 15:31, Paul Go pgo...@gmail.com wrote: Is there a way to get size statistics (disc space, number of items, number of objects, etc) per collection in DSpace? Hi Paul, DSpace can display number of items. You didn't write which DSpace version, interface and theme you're using, so I'll assume 1.8.2/XMLUI/Mirage. To enable showing number of items, you need to schedule periodic run of [dspace]/bin/dspace itemcounter, then in dspace.cfg set webui.strengths.show = true webui.strengths.cache = true and restart Tomcat. If you want to calculate the other statistics, your best bet is to take the data directly from the database. The queries will be complicated, but it is possible. You can find the database schema here: https://wiki.duraspace.org/display/DSPACE/DSpace+2.0+Requirements+and+Issues#DSpace2.0RequirementsandIssues-DatabaseOverviewGraphic Regards, ~~helix84 -- Better than sec? Nothing is better than sec when it comes to monitoring Big Data applications. Try Boundary one-second resolution app monitoring today. Free. http://p.sf.net/sfu/Boundary-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics: Collection sizes
Hi, Paul, you might also want to look into this patch, submitted by Mark Wood: https://jira.duraspace.org/browse/DS-552 I have been intending to play around with this patch for some time, but have not yet gotten around to doing it. -- HARDY POTTINGER pottinge...@umsystem.edu University of Missouri Library Systems http://lso.umsystem.edu/~pottingerhj/ https://MOspace.umsystem.edu/ No matter how far down the wrong road you've gone, turn back. --Turkish proverb On 4/4/12 8:39 AM, helix84 heli...@centrum.sk wrote: On Wed, Apr 4, 2012 at 15:31, Paul Go pgo...@gmail.com wrote: Is there a way to get size statistics (disc space, number of items, number of objects, etc) per collection in DSpace? Hi Paul, DSpace can display number of items. You didn't write which DSpace version, interface and theme you're using, so I'll assume 1.8.2/XMLUI/Mirage. To enable showing number of items, you need to schedule periodic run of [dspace]/bin/dspace itemcounter, then in dspace.cfg set webui.strengths.show = true webui.strengths.cache = true and restart Tomcat. If you want to calculate the other statistics, your best bet is to take the data directly from the database. The queries will be complicated, but it is possible. You can find the database schema here: https://wiki.duraspace.org/display/DSPACE/DSpace+2.0+Requirements+and+Issu es#DSpace2.0RequirementsandIssues-DatabaseOverviewGraphic Regards, ~~helix84 -- Better than sec? Nothing is better than sec when it comes to monitoring Big Data applications. Try Boundary one-second resolution app monitoring today. Free. http://p.sf.net/sfu/Boundary-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Better than sec? Nothing is better than sec when it comes to monitoring Big Data applications. Try Boundary one-second resolution app monitoring today. Free. http://p.sf.net/sfu/Boundary-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] statistics on dspace 1.7
Hi All I was trying to generate stats and the following comes up after I used stat-initial command, any idea -bash-3.00$ ./dspace stat-initial Passed log directory is not a directory Regards, Lewatle htmlpfont face = verdana size = 0.8 color = navyThis communication is intended for the addressee only. It is confidential. If you have received this communication in error, please notify us immediately and destroy the original message. You may not copy or disseminate this communication without the permission of the University. Only authorized signatories are competent to enter into agreements on behalf of the University and recipients are thus advised that the content of this message may not be legally binding on the University and may contain the personal views and opinions of the author, which are not necessarily the views and opinions of The University of the Witwatersrand, Johannesburg. All agreements between the University and outsiders are subject to South African Law unless the University agrees in writing to the contrary./font/p/html -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics error with DSpace 1.8.1
Hi I am having problem with the dspace stats script following an upgrade from 1.7.1 to 1.8.1 The solr server is running and lynx http://127.0.0.1/solr/statistics/select?q=*:* works fine and returns the statistics file However when I try to run the dspace stats script I get the following error [dspace@standbyvle bin]$ dspace stats-util -b -r Exception: Error executing query org.apache.solr.client.solrj.SolrServerException: Error executing query at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:95) at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:118) at org.dspace.statistics.SolrLogger.reindexBitstreamHits(SolrLogger.java:1009) at org.dspace.statistics.util.StatisticsClient.main(StatisticsClient.java:96) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) Caused by: org.apache.solr.common.SolrException: /solr/statistics/select /solr/statistics/select request: http://localhost:8080/solr/statistics/select?q=*:*fq=type:0fq=-bundleName:[* TO *]rows=0wt=javabinversion=2 at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:435) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:244) at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:89) ... 8 more It looks as if it is looking for solr at localhost:8080. Any idea how I can change the URL/port number its looking for here please? I have already set the entries in the appropriate config/modules files to point to the correct URL for solr. Thanks very much Clive -- RSA(R) Conference 2012 Mar 27 - Feb 2 Save $400 by Jan. 27 Register now! http://p.sf.net/sfu/rsa-sfdev2dev2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics error with DSpace 1.8.1
Clive, You can change the URL/port where DSpace looks for the Solr Statistics server in the following config file: [dspace]/modules/solr-statistics.cfg Look for this entry: server = http://localhost:8080/solr/statistics It looks like you need it to instead be set to: server = http://127.0.0.1/solr/statistics More info can be found in the Solr Statistics Documentation at: https://wiki.duraspace.org/display/DSDOC18/DSpace+Statistics#DSpaceStatistics-ConfigurationsettingsforStatistics (Side Note: if you plan to use Discovery (Solr-based faceted search/browse), you likely will also need to similarly edit the Solr 'search.server' setting in the [dspace]/modules/discover.cfg config file.) - Tim On 1/13/2012 7:03 AM, Clive Gould wrote: Hi I am having problem with the dspace stats script following an upgrade from 1.7.1 to 1.8.1 The solr server is running and lynx http://127.0.0.1/solr/statistics/select?q=*:* works fine and returns the statistics file However when I try to run the dspace stats script I get the following error [dspace@standbyvle bin]$ dspace stats-util -b -r Exception: Error executing query org.apache.solr.client.solrj.SolrServerException: Error executing query at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:95) at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:118) at org.dspace.statistics.SolrLogger.reindexBitstreamHits(SolrLogger.java:1009) at org.dspace.statistics.util.StatisticsClient.main(StatisticsClient.java:96) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) Caused by: org.apache.solr.common.SolrException: /solr/statistics/select /solr/statistics/select request: http://localhost:8080/solr/statistics/select?q=*:*fq=type:0fq=-bundleName:[* TO *]rows=0wt=javabinversion=2 at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:435) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:244) at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:89) ... 8 more It looks as if it is looking for solr at localhost:8080. Any idea how I can change the URL/port number its looking for here please? I have already set the entries in the appropriate config/modules files to point to the correct URL for solr. Thanks very much Clive -- RSA(R) Conference 2012 Mar 27 - Feb 2 Save $400 by Jan. 27 Register now! http://p.sf.net/sfu/rsa-sfdev2dev2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- RSA(R) Conference 2012 Mar 27 - Feb 2 Save $400 by Jan. 27 Register now! http://p.sf.net/sfu/rsa-sfdev2dev2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics error with DSpace 1.8.1
Hi Tim Thanks for this, but what is worrying me is that the solr-statistics.cfg file already contains the required changes :( I've run mvn and ant update Could this be a bug??? See below Clive /home/dspace/dspace-1.8.1-src-release/dspace/config/modules [dspace@standbyvle modules]$ cat solr-statistics.cfg #---# #--SOLR STATISTICS CONFIGURATIONS---# #---# # These configs are only used by the SOLR interface/webapp to # # track usage statistics. # #---# # Usage Logging # # set this to be the port you run the dspace solr webapp # on, by default, we are assuming a test configuration with # tomcat still running on port 8080 server = http://127.0.0.1/solr/statistics etc. and [dspace@standbyvle modules]$ cat discovery.cfg #---# #-DISCOVERY CONFIGURATIONS--# #---# # Configuration properties used solely by the Discovery # # faceted-search system.# #---# # Search Indexing # search.server = http://127.0.0.1/solr/search etc On Fri, Jan 13, 2012 at 3:02 PM, Tim Donohue tdono...@duraspace.org wrote: Clive, You can change the URL/port where DSpace looks for the Solr Statistics server in the following config file: [dspace]/modules/solr-statistics.cfg Look for this entry: server = http://localhost:8080/solr/statistics It looks like you need it to instead be set to: server = http://127.0.0.1/solr/statistics More info can be found in the Solr Statistics Documentation at: https://wiki.duraspace.org/display/DSDOC18/DSpace+Statistics#DSpaceStatistics-ConfigurationsettingsforStatistics (Side Note: if you plan to use Discovery (Solr-based faceted search/browse), you likely will also need to similarly edit the Solr 'search.server' setting in the [dspace]/modules/discover.cfg config file.) - Tim On 1/13/2012 7:03 AM, Clive Gould wrote: Hi I am having problem with the dspace stats script following an upgrade from 1.7.1 to 1.8.1 The solr server is running and lynx http://127.0.0.1/solr/statistics/select?q=*:* works fine and returns the statistics file However when I try to run the dspace stats script I get the following error [dspace@standbyvle bin]$ dspace stats-util -b -r Exception: Error executing query org.apache.solr.client.solrj.SolrServerException: Error executing query at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:95) at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:118) at org.dspace.statistics.SolrLogger.reindexBitstreamHits(SolrLogger.java:1009) at org.dspace.statistics.util.StatisticsClient.main(StatisticsClient.java:96) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) Caused by: org.apache.solr.common.SolrException: /solr/statistics/select /solr/statistics/select request: http://localhost:8080/solr/statistics/select?q=*:*fq=type:0fq=-bundleName:[* TO *]rows=0wt=javabinversion=2 at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:435) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:244) at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:89) ... 8 more It looks as if it is looking for solr at localhost:8080. Any idea how I can change the URL/port number its looking for here please? I have already set the entries in the appropriate config/modules files to point to the correct URL for solr. Thanks very much Clive -- RSA(R) Conference 2012 Mar 27 - Feb 2 Save $400 by Jan. 27 Register now! http://p.sf.net/sfu/rsa-sfdev2dev2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- RSA(R) Conference 2012 Mar 27 - Feb 2 Save $400 by Jan. 27 Register now! http://p.sf.net/sfu/rsa-sfdev2dev2 ___ DSpace-tech mailing list
Re: [Dspace-tech] Statistics Dspace
Hello all, In Dspace Statistics, where is 'Words Searched words are saved in the postgresql database? Can i use there words for making tag cloud? Thanks Regards! -- View this message in context: http://dspace.2283337.n4.nabble.com/Stadistics-Dspace-tp3278923p4264726.html Sent from the DSpace - Tech mailing list archive at Nabble.com. -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics for Individual Author/Creators
Has anyone tried to generate custom statistics for individual author/creators? One of my curators has asked for views/downloads of all his electronic reprints but I can't see a way to either query the server from the back-end, or generate this from our UI (jsp). Statistics are available for individual items on the corresponding page and top-downloaded papers are available on the general statistics page. But a custom output that filters by author, doesn't appear to be do-able. Am I missing something? Has anyone else entertained or received this kind of request from one of their depositors? Thanks in advance and please excuse the cross-posting. Alvin Alvin Hutchinson Smithsonian Institution Libraries (202) 633-1031 visit Smithsonian Research Onlinehttp://research.si.edu/ -- Doing More with Less: The Next Generation Virtual Desktop What are the key obstacles that have prevented many mid-market businesses from deploying virtual desktops? How do next-generation virtual desktops provide companies an easier-to-deploy, easier-to-manage and more affordable virtual desktop model.http://www.accelacomm.com/jaw/sfnl/114/51426474/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics for Individual Author/Creators
Hi Alvin, DSpace doesn't do that kind of thing yet. Author Pages was a feature build a while back from uRochester, which gave each author a bit of a portal to be showcased. I've been working pretty heavily in making customized reports for our repo admins so that they can answer the kind of questions that strike their fancy. Thus far, top downloads for the entire site, top downloads for this collection/community, etc are pretty common questions. Example: Top Downloads for the month report: https://picasaweb.google.com/115522466408243604820/OSULibrariesDSpaceDesigns#5651530396792873954 To solve the authors-downloads question. You'd need to build a page for all of your authors (probably starting from the browse code for authors). From there, combine some solr queries for each of their items to get your data. Peter Dietz On Mon, Sep 12, 2011 at 12:42 PM, Hutchinson, Alvin hutchins...@si.eduwrote: Has anyone tried to generate custom statistics for individual author/creators? ** ** One of my curators has asked for views/downloads of all his electronic reprints but I can’t see a way to either query the server from the back-end, or generate this from our UI (jsp). ** ** Statistics are available for individual items on the corresponding page and top-downloaded papers are available on the general statistics page. ** ** But a custom output that filters by author, doesn’t appear to be do-able.* *** ** ** Am I missing something? ** ** Has anyone else “entertained” or received this kind of request from one of their depositors? ** ** ** ** Thanks in advance and please excuse the cross-posting. ** ** Alvin ** ** Alvin Hutchinson Smithsonian Institution Libraries (202) 633-1031 visit Smithsonian Research Online http://research.si.edu/ ** ** -- Doing More with Less: The Next Generation Virtual Desktop What are the key obstacles that have prevented many mid-market businesses from deploying virtual desktops? How do next-generation virtual desktops provide companies an easier-to-deploy, easier-to-manage and more affordable virtual desktop model.http://www.accelacomm.com/jaw/sfnl/114/51426474/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Doing More with Less: The Next Generation Virtual Desktop What are the key obstacles that have prevented many mid-market businesses from deploying virtual desktops? How do next-generation virtual desktops provide companies an easier-to-deploy, easier-to-manage and more affordable virtual desktop model.http://www.accelacomm.com/jaw/sfnl/114/51426474/___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics versions
Hi All Is it possible to run DSpace version 1.5.2 stats and DSpace version 1.6.2 stats at the same time ? Cheers hg -- Hilton Gibson Systems Administrator JS Gericke Library Room 1025 Stellenbosch University Private Bag X5036 Stellenbosch 7599 South Africa Tel: +27 21 808 4100 | Cell: +27 84 646 4758 Simplicity is the ultimate sophistication Leonardo da Vinci -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics versions
Assuming you mean 'classic' dspace.log based stats (1.5) and 'solr' stats (1.6) Yes. Out the box, 1.6+ does this by default. They are completely separate and have no relation to each other in how they work, or collect / display statistics. Both work together. Thanks, Stuart Lewis Digital Development Manager Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 3/02/2011, at 9:06 AM, Hilton Gibson wrote: Hi All Is it possible to run DSpace version 1.5.2 stats and DSpace version 1.6.2 stats at the same time ? Cheers hg -- Hilton Gibson Systems Administrator JS Gericke Library Room 1025 Stellenbosch University Private Bag X5036 Stellenbosch 7599 South Africa Tel: +27 21 808 4100 | Cell: +27 84 646 4758 Simplicity is the ultimate sophistication Leonardo da Vinci ATT1..txtATT2..txt -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] statistics generation question
Hi again, I had a look, and I see one example at: http://ir.uz.ac.zw:8080/xmlui/handle/10646/512/statistics which is indeed blank. This could be caused by a few things. When you changed the solr server reference in your dspace.cfg file, did you restart Tomcat, or just reload the jspui webapp? The Manakin xmlui front end may still be using the old container. A blank page such as yours was the problem I had before I set my solr server to the full URL of my SOLR instance. Is your dstat.cfg file set up correctly? You are correctly logging stats for the various dc.types you want? Is there anything in your DSpace or Tomcat log files? An obvious indication that DSpace is connecting to SOLR when you view stats is that you will see many lines of logs for SOLR queries on each page load. You may have to increase the log level. Regards, Jason On 2010-12-15, at 3:19 AM, amutsikiwa wrote: Hi Jason, I am able to view the general statistics page which is available on http://ir.uz.ac.zw:8080/jspui/statistics or on http://ir.uz.ac.zw:8080/dspace/statistics (as you have noted. I created a symbolic link dspace to the jspui interface). My problem is when viewing item-level statistics. Before upgrading from DSpace 1.6.1 to 1.6.2 , I was able to view item-level statistics but now I am getting a blank page . From: Jason Nugent [mailto:jnug...@unb.ca] Sent: Tuesday, December 14, 2010 9:45 PM To: Jason Nugent Cc: DSpace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] statistics generation question Actually, I just quickly tested your DSpace installation, and your statistics are available at: http://ir.uz.ac.zw:8080/dspace/statistics or also http://ir.uz.ac.zw:8080/xmlui/statistics Depending on which front end you prefer to use. Jason On 2010-12-14, at 3:00 PM, Jason Nugent wrote: Hello, The URL for /solr/statistics is only used by DSpace itself, for generation of statistics. It's not the URL that you use for viewing them. If you want to view them, there should be a link for statistics on the bottom right of the menu on the front of your DSpace installation. In your case, it would probably be: http://ir.uz.ac.zw:8080/statistics Regards, Jason On 2010-12-14, at 2:46 PM, amutsikiwa wrote: I was very happy to bumb into this thread. I am experiencing the same problems as Jason was experiencing. I checked on my solr.log.server in the dspace.cfg file. It was set to ${dspace.baseUrl}/solr/statistics and I modified it to http://localhost:8080/solr/statistics as directed below. I rebuild dspace (mvn package) and them run ant update. When I point my browser to http://ir.uz.ac.zw:8080/solr/statistics, I get a HTTP Status 403- description Access to the specified resource () has been forbidden. Iam at a loss as to where I am getting it wrong. -- Jason Nugent jnug...@unb.ca Programmer/Analyst, UNB Libraries (506) 447-3177 -- Jason Nugent jnug...@unb.ca Programmer/Analyst, UNB Libraries (506) 447-3177 -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. Jason Nugent jnug...@unb.ca 506 447 3177 Programmer/Analyst, Harriet Irving Library University of New Brunswick -- Lotusphere 2011 Register now for Lotusphere 2011 and learn how to connect the dots, take your collaborative environment to the next level, and enter the era of Social Business. http://p.sf.net/sfu/lotusphere-d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] statistics generation question
I was very happy to bumb into this thread. I am experiencing the same problems as Jason was experiencing. I checked on my solr.log.server in the dspace.cfg file. It was set to ${dspace.baseUrl}/solr/statistics and I modified it to http://localhost:8080/solr/statistics as directed below. I rebuild dspace (mvn package) and them run ant update. When I point my browser to http://ir.uz.ac.zw:8080/solr/statistics, I get a HTTP Status 403- description Access to the specified resource () has been forbidden. Iam at a loss as to where I am getting it wrong. -Original Message- From: Jason Nugent [mailto:jnug...@unb.ca] Sent: Friday, December 10, 2010 3:57 PM To: DSpace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] statistics generation question Hi Stuart, I've tracked down what my issue was. SOLR was properly deployed, but the 1.6.0 dspace.cfg file appeared to default to the baseUrl property, not localhost:8080, so my instance was bumping into the LocalHostRestrictionFilter.enabled property, which is not disabled by default in the web.xml file that ships with the webapp. solr.log.server = ${dspace.baseUrl}/solr/statistics With that filter in place, anything other than localhost for a domain will fail silently. I haven't checked to see if this is still the case in newer DSpace releases. Cheers, Jason On 2010-12-09, at 5:00 PM, Stuart Lewis wrote: Hi Jason, In 1.6+ there are two forms of statistics. There is the 'classic' statistics that used to be there and continues to be, and the new 'solr' statistics. The classic statistics are available from /statistics and are generated nightly from your dspace.log files. The solr statistics rely on a new webapp being deployed. The solr webapp needs to be deployed, and is configured in dspace.cfg: - solr.log.server = http://localhost:8080/solr/statistics This collects events 'as they happen', and logs them into a solr index in real-time so that the statics are always up to date. It is these statistics that are shown on the community / collection / item pages. The solr stats also perform other tasks that Minho stats provided, such as logging of the geographical location of the visits. I hope this helps, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 10/12/2010, at 8:04 AM, Jason Nugent wrote: Hi everyone, I am curious about the stats reporting in DSpace 1.6.x. I'm running a 1.6.0 installation and I've noticed that the general stats pages do have stats, but if I drill down into a particular collection at a particular handle, I also have a statistics link that points to a URL with a handle in it. Clicking that link gives me a Manakin themed page which is empty. My top level pages do show stats, and I can browse by month without problem. Is this simply a UI issue and that link shouldn't exist? maybe a relative path to statistics instead of an absolute one to the top of my DSpace installation? Bug in the UI, maybe? Here's an example of that: http://dspace.hil.unb.ca:8080/handle/1882/38 The link in the lower right (you'd need to log in to see it) points to http://dspace.hil.unb.ca:8080/handle/1882/38/statistics which doesn't seem right. My./stats-* report generation tools run just fine. Also, I was wondering if the add-on for statistics, originally created by the University of Minho, will ever be updated for newer versions? Has anyone looked at creating a Manakin-compatible stats addon? Thanks, Jason - Programmer/Analyst University of New Brunswick Libraries jnug...@unb.ca (506) 447 3177 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. -- Lotusphere 2011 Register now for Lotusphere 2011 and learn how to connect the dots, take your collaborative environment to the next level, and enter the era of Social Business. http://p.sf.net/sfu/lotusphere-d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] statistics generation question
Hello, The URL for /solr/statistics is only used by DSpace itself, for generation of statistics. It's not the URL that you use for viewing them. If you want to view them, there should be a link for statistics on the bottom right of the menu on the front of your DSpace installation. In your case, it would probably be: http://ir.uz.ac.zw:8080/statistics Regards, Jason On 2010-12-14, at 2:46 PM, amutsikiwa wrote: I was very happy to bumb into this thread. I am experiencing the same problems as Jason was experiencing. I checked on my solr.log.server in the dspace.cfg file. It was set to ${dspace.baseUrl}/solr/statistics and I modified it to http://localhost:8080/solr/statistics as directed below. I rebuild dspace (mvn package) and them run ant update. When I point my browser to http://ir.uz.ac.zw:8080/solr/statistics, I get a HTTP Status 403- description Access to the specified resource () has been forbidden. Iam at a loss as to where I am getting it wrong. -- Jason Nugent jnug...@unb.ca Programmer/Analyst, UNB Libraries (506) 447-3177 -- Lotusphere 2011 Register now for Lotusphere 2011 and learn how to connect the dots, take your collaborative environment to the next level, and enter the era of Social Business. http://p.sf.net/sfu/lotusphere-d2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] statistics generation question
Actually, I just quickly tested your DSpace installation, and your statistics are available at: http://ir.uz.ac.zw:8080/dspace/statistics or also http://ir.uz.ac.zw:8080/xmlui/statistics Depending on which front end you prefer to use. Jason On 2010-12-14, at 3:00 PM, Jason Nugent wrote: Hello, The URL for /solr/statistics is only used by DSpace itself, for generation of statistics. It's not the URL that you use for viewing them. If you want to view them, there should be a link for statistics on the bottom right of the menu on the front of your DSpace installation. In your case, it would probably be: http://ir.uz.ac.zw:8080/statistics Regards, Jason On 2010-12-14, at 2:46 PM, amutsikiwa wrote: I was very happy to bumb into this thread. I am experiencing the same problems as Jason was experiencing. I checked on my solr.log.server in the dspace.cfg file. It was set to ${dspace.baseUrl}/solr/statistics and I modified it to http://localhost:8080/solr/statistics as directed below. I rebuild dspace (mvn package) and them run ant update. When I point my browser to http://ir.uz.ac.zw:8080/solr/statistics, I get a HTTP Status 403- description Access to the specified resource () has been forbidden. Iam at a loss as to where I am getting it wrong. -- Jason Nugent jnug...@unb.ca Programmer/Analyst, UNB Libraries (506) 447-3177 -- Jason Nugent jnug...@unb.ca Programmer/Analyst, UNB Libraries (506) 447-3177 -- Lotusphere 2011 Register now for Lotusphere 2011 and learn how to connect the dots, take your collaborative environment to the next level, and enter the era of Social Business. http://p.sf.net/sfu/lotusphere-d2d___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] statistics generation question
Hi Stuart, I've tracked down what my issue was. SOLR was properly deployed, but the 1.6.0 dspace.cfg file appeared to default to the baseUrl property, not localhost:8080, so my instance was bumping into the LocalHostRestrictionFilter.enabled property, which is not disabled by default in the web.xml file that ships with the webapp. solr.log.server = ${dspace.baseUrl}/solr/statistics With that filter in place, anything other than localhost for a domain will fail silently. I haven't checked to see if this is still the case in newer DSpace releases. Cheers, Jason On 2010-12-09, at 5:00 PM, Stuart Lewis wrote: Hi Jason, In 1.6+ there are two forms of statistics. There is the 'classic' statistics that used to be there and continues to be, and the new 'solr' statistics. The classic statistics are available from /statistics and are generated nightly from your dspace.log files. The solr statistics rely on a new webapp being deployed. The solr webapp needs to be deployed, and is configured in dspace.cfg: - solr.log.server = http://localhost:8080/solr/statistics This collects events 'as they happen', and logs them into a solr index in real-time so that the statics are always up to date. It is these statistics that are shown on the community / collection / item pages. The solr stats also perform other tasks that Minho stats provided, such as logging of the geographical location of the visits. I hope this helps, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: +64 (0)9 373 7599 x81928 On 10/12/2010, at 8:04 AM, Jason Nugent wrote: Hi everyone, I am curious about the stats reporting in DSpace 1.6.x. I'm running a 1.6.0 installation and I've noticed that the general stats pages do have stats, but if I drill down into a particular collection at a particular handle, I also have a statistics link that points to a URL with a handle in it. Clicking that link gives me a Manakin themed page which is empty. My top level pages do show stats, and I can browse by month without problem. Is this simply a UI issue and that link shouldn't exist? maybe a relative path to statistics instead of an absolute one to the top of my DSpace installation? Bug in the UI, maybe? Here's an example of that: http://dspace.hil.unb.ca:8080/handle/1882/38 The link in the lower right (you'd need to log in to see it) points to http://dspace.hil.unb.ca:8080/handle/1882/38/statistics which doesn't seem right. My./stats-* report generation tools run just fine. Also, I was wondering if the add-on for statistics, originally created by the University of Minho, will ever be updated for newer versions? Has anyone looked at creating a Manakin-compatible stats addon? Thanks, Jason - Programmer/Analyst University of New Brunswick Libraries jnug...@unb.ca (506) 447 3177 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] statistics generation question
Hi everyone, I am curious about the stats reporting in DSpace 1.6.x. I'm running a 1.6.0 installation and I've noticed that the general stats pages do have stats, but if I drill down into a particular collection at a particular handle, I also have a statistics link that points to a URL with a handle in it. Clicking that link gives me a Manakin themed page which is empty. My top level pages do show stats, and I can browse by month without problem. Is this simply a UI issue and that link shouldn't exist? maybe a relative path to statistics instead of an absolute one to the top of my DSpace installation? Bug in the UI, maybe? Here's an example of that: http://dspace.hil.unb.ca:8080/handle/1882/38 The link in the lower right (you'd need to log in to see it) points to http://dspace.hil.unb.ca:8080/handle/1882/38/statistics which doesn't seem right. My./stats-* report generation tools run just fine. Also, I was wondering if the add-on for statistics, originally created by the University of Minho, will ever be updated for newer versions? Has anyone looked at creating a Manakin-compatible stats addon? Thanks, Jason - Programmer/Analyst University of New Brunswick Libraries jnug...@unb.ca (506) 447 3177 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] statistics' link does not work
Hi Gagan When you ran each of the 6 perl scripts [ of stats] manually , What was the results produced by scripts ? Did scripts ran successfully ? Please also check the log directory path @ dspace/config/dstat.cfg Hope this would help Thanks Regards Hardik Mishra Software Engineer Give a man a fish, and you feed him for a day. Teach a man to catch fish and you feed him for a lifetime. Message: 6 Date: Tue, 6 Jul 2010 15:13:29 +0530 From: Gagan Mandayam gagan.manda...@jsw.in Subject: [Dspace-tech] DSPace 1.4.2 statistics problem To: dspace-tech@lists.sourceforge.net Message-ID: 4a2c78$64i...@droutbound.logix.in Content-Type: text/plain; charset=us-ascii Hi Again, We are successfully running DSpace 1.4.2 for our Library. But the 'statistics' link does not work. (when clicked, shows empty page). The \reports folder is empty; Can someone pls guide us the steps asap. we manually ran each of the 6 perl scripts [ of stats] ; still no luck; thanks-gagan-m, Bangalore-india -- This SF.net email is sponsored by Sprint What will you do first with EVO, the first 4G phone? Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] statistics not working (ver 1.4.2)
Hi, We are successfully running DSpace 1.4.2 for our Library. But the 'statistics' link does not work. (when clicked, shows empty page). The \reports folder is empty; Can _someone pls guide us the exact steps for ver 1.4.2. only_. we manually ran each of the 6 perl scripts [ of stats] ; still no luck; thanks-gagan -- This SF.net email is sponsored by Sprint What will you do first with EVO, the first 4G phone? Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics not populating in DSpace 1.6
Hello, We have been trying to configure Statistics on DSpace 1.6. For some reason the statistics are populating for the individual items, but when I go to Administer Statistics, all of the fields are either blank or 0. These are some of our Solr settings, in dspace.cfg solr.log.server = http://127.0.0.1:8080/solr/statistics solr.dbfile = /usr/local/dspace/config/GeoLiteCity.dat useProxies = true statistics.item.authorization.admin=false statistics.items.dc.1=dc.identifier statistics.items.dc.2=dc.date.accesioned statistics.items.type.1=dcinput statistics.items.type.2=date statistics.default.start.datepick = 01/01/2010 I looked in [dspace]/log, and found that dspace.log is missing, or is that by design? We are unsure of what else to configure to have this work properly. Let me know if more information is needed. Thanks -- This SF.net email is sponsored by Sprint What will you do first with EVO, the first 4G phone? Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics not populating in DSpace 1.6
It looks like SOLR is working fine, but you have a file permissions issue with [dspace]/log. So to fix this, you'll need to ensure that the tomcat user has write access to [dspace]/log. On linux, this usually involves making sure the tomcat user is the same user who owns all the files in your [dspace] directory, or by setting permissions so that the tomcat user's group has write permission to those files. You'll know you have this working when you restart tomcat, and the file [dspace]/log/dspace.log or [dspace]/log/dspace.log.2010-06-28 is being written to. DSpace - Administrator - Statistics generates its data from legacy statistics, which involves a cron task that reads all of your dspace.log* files and creates these reports. SOLR is different, and keeps record of hits to items, bitstream, collections, and communities, and you can see those by going to an item page, and clicking View Statistics. It is able to keep incrementing the hits, although you have any dspace.log files because hits are added directly to SOLR. The admin section for solr is more technical, and not geared towards dspace things, but is located at: http://localhost:8080/solr/statistics/admin/ You can only access that via localhost, so you have be at the machine running dspace to see that. Peter Dietz Systems Developer/Engineer Ohio State University Libraries On Mon, Jun 28, 2010 at 12:10 PM, DSpace dsp...@nps.edu wrote: Hello, We have been trying to configure Statistics on DSpace 1.6. For some reason the statistics are populating for the individual items, but when I go to Administer Statistics, all of the fields are either blank or 0. These are some of our Solr settings, in dspace.cfg solr.log.server = http://127.0.0.1:8080/solr/statistics solr.dbfile = /usr/local/dspace/config/GeoLiteCity.dat useProxies = true statistics.item.authorization.admin=false statistics.items.dc.1=dc.identifier statistics.items.dc.2=dc.date.accesioned statistics.items.type.1=dcinput statistics.items.type.2=date statistics.default.start.datepick = 01/01/2010 I looked in [dspace]/log, and found that dspace.log is missing, or is that by design? We are unsure of what else to configure to have this work properly. Let me know if more information is needed. Thanks -- This SF.net email is sponsored by Sprint What will you do first with EVO, the first 4G phone? Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- This SF.net email is sponsored by Sprint What will you do first with EVO, the first 4G phone? Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics
All, We have a test installation of dspace 1.6 and are attempting to set up statistics but have encountered two problems that I cannot seem to find a solution for yet. The first is that I cannot seem to find a way to create solr statistical reports. The old logs imported fine but I do not see any reports. Second is that non-administrative users cannot even see the statistics link even though I have statistics.item.authorization.admin set to false. Any suggestions? Thanks. --Dale --- Dale Poulter Automation Coordinator Library Information Technology Services Vanderbilt University Suite 700 110 21st Avenue South Nashville, TN 37240 (615)343-5388 (615)343-8834 (fax) (615)207-9705 (cell) dale.poul...@vanderbilt.edumailto:dale.poul...@vanderbilt.edu -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics in 1.6
Stuart, Thanks. I had failed to define the solr path in the server.xml file. Once I did that things moved a little further but I am unable to connect to the solr server (see error below). Processing file: /dspace/newlog/dspace.log.2009-06-28 java.net.ConnectException: Connection refused org.apache.solr.client.solrj.SolrServerException: java.net.ConnectException: Connection refused at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:391) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:183) at org.apache.solr.client.solrj.request.UpdateRequest.process(UpdateRequest.java:217) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:63) at org.dspace.statistics.util.StatisticsImporter.load(StatisticsImporter.java:361) at org.dspace.statistics.util.StatisticsImporter.main(StatisticsImporter.java:493) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:194) Caused by: java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333) at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195) at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) at java.net.Socket.connect(Socket.java:525) at java.net.Socket.connect(Socket.java:475) at java.net.Socket.init(Socket.java:372) at java.net.Socket.init(Socket.java:246) at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:80) at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:122) at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707) at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361) at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387) at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:335) ... 10 more Processed 1 log lines - 0 entries added to solr: 0% - 1 errors: 100% - 0 search engine activity skipped: 0% About to commit data to solr...Error committing statistics to solr server! From: Stuart Lewis [mailto:s.le...@auckland.ac.nz] Sent: Saturday, March 06, 2010 1:18 AM To: Poulter, Dale; Dspace-tech@lists.sourceforge.net Subject: RE: Statistics in 1.6 Hi Dale, What do you have set in dspace.cfg for 'solr.log.server'? Hopefully it will be something like: '${dspace.baseURL}/solr/statistics'? Assuming it is: i) Have you installed the 'solr' webapp as 'solr' (some people rename their webapps) ii) What setting doyou have in dspace.cfg for dspace.baseUrl? Thanks, Stuart From: Poulter, Dale [dale.poul...@vanderbilt.edu] Sent: Saturday, 6 March 2010 1:38 p.m. To: Dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Statistics in 1.6 Good evening all, We have been able to successfully install 1.6 and the system seems to be working great so far. However, after we successfully converted the old logs we have been unable to import the new logs. After several attempts, we regularly get the error below. Any suggestions as to the cause? Thanks, bash-3.00# ./dspace stats-log-importer -i /dspace/newlog/dspace.log -m Exception: null java.net.MalformedURLException at java.net.URL.init(URL.java:601) at java.net.URL.init(URL.java:464) at java.net.URL.init(URL.java:413) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.init(CommonsHttpSolrServer.java:97) at org.dspace.statistics.util.StatisticsImporter.main(StatisticsImporter.java:470) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597
Re: [Dspace-tech] Statistics in 1.6
Hi Dale, Are there any messages in either dspace.log or tomcat's catalina.log that appear when you start tomcat that say whether the solr webapp is starting up succesfully or not? Something else to try - by default the statistics solr instance is configured to only accept connections from the local server itself. This is to prevent external users making queires directly to your solr server. Sometimes we've seen solr think that you are not coming from the local server if you contact it via your-dspace-server.example.com. Instead you could try using http://127.0.0.1:8080/solr/statistics as the setting for solr.log.server in dspace.cfg (adjust web app name and port as approproate). We found that by using 127.0.0.1 rather than the hostname, this is less prone to tomcat getting muddled up over what is a request from 'localhost' and what is coming from elsewhere. I hope this helps, Stuart From: Poulter, Dale [dale.poul...@vanderbilt.edu] Sent: Sunday, 7 March 2010 4:59 a.m. To: Stuart Lewis; Dspace-tech@lists.sourceforge.net Subject: RE: Statistics in 1.6 Stuart, Thanks. I had failed to define the solr path in the server.xml file. Once I did that things moved a little further but I am unable to connect to the solr server (see error below). Processing file: /dspace/newlog/dspace.log.2009-06-28 java.net.ConnectException: Connection refused org.apache.solr.client.solrj.SolrServerException: java.net.ConnectException: Connection refused at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:391) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:183) at org.apache.solr.client.solrj.request.UpdateRequest.process(UpdateRequest.java:217) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:63) at org.dspace.statistics.util.StatisticsImporter.load(StatisticsImporter.java:361) at org.dspace.statistics.util.StatisticsImporter.main(StatisticsImporter.java:493) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:194) Caused by: java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333) at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195) at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) at java.net.Socket.connect(Socket.java:525) at java.net.Socket.connect(Socket.java:475) at java.net.Socket.init(Socket.java:372) at java.net.Socket.init(Socket.java:246) at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:80) at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:122) at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707) at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361) at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387) at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:335) ... 10 more Processed 1 log lines - 0 entries added to solr: 0% - 1 errors: 100% - 0 search engine activity skipped: 0% About to commit data to solr...Error committing statistics to solr server! From: Stuart Lewis [mailto:s.le...@auckland.ac.nz] Sent: Saturday, March 06, 2010 1:18 AM To: Poulter, Dale; Dspace-tech@lists.sourceforge.net Subject: RE: Statistics in 1.6 Hi Dale, What do you have set in dspace.cfg for 'solr.log.server'? Hopefully it will be something like: '${dspace.baseURL}/solr/statistics'? Assuming it is: i) Have you installed the 'solr' webapp as 'solr' (some people rename their webapps) ii) What setting doyou have in dspace.cfg for dspace.baseUrl? Thanks, Stuart From: Poulter, Dale [dale.poul...@vanderbilt.edu] Sent: Saturday, 6 March 2010 1:38 p.m. To: Dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Statistics in 1.6
Re: [Dspace-tech] Statistics in 1.6
installed the 'solr' webapp as 'solr' (some people rename their webapps) ii) What setting doyou have in dspace.cfg for dspace.baseUrl? Thanks, Stuart From: Poulter, Dale [dale.poul...@vanderbilt.edu] Sent: Saturday, 6 March 2010 1:38 p.m. To: Dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Statistics in 1.6 Good evening all, We have been able to successfully install 1.6 and the system seems to be working great so far. However, after we successfully converted the old logs we have been unable to import the new logs. After several attempts, we regularly get the error below. Any suggestions as to the cause? Thanks, bash-3.00# ./dspace stats-log-importer -i /dspace/newlog/dspace.log -m Exception: null java.net.MalformedURLException at java.net.URL.init(URL.java:601) at java.net.URL.init(URL.java:464) at java.net.URL.init(URL.java:413) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.init(CommonsHttpSolrServer.java:97) at org.dspace.statistics.util.StatisticsImporter.main(StatisticsImporter.java:470) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:194) --Dale --- Dale Poulter Automation Coordinator Library Information Technology Services Vanderbilt University Suite 700 110 21st Avenue South Nashville, TN 37240 (615)343-5388 (615)343-8834 (fax) (615)207-9705 (cell) dale.poul...@vanderbilt.edumailto:dale.poul...@vanderbilt.edu -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics in 1.6
Good evening all, We have been able to successfully install 1.6 and the system seems to be working great so far. However, after we successfully converted the old logs we have been unable to import the new logs. After several attempts, we regularly get the error below. Any suggestions as to the cause? Thanks, bash-3.00# ./dspace stats-log-importer -i /dspace/newlog/dspace.log -m Exception: null java.net.MalformedURLException at java.net.URL.init(URL.java:601) at java.net.URL.init(URL.java:464) at java.net.URL.init(URL.java:413) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.init(CommonsHttpSolrServer.java:97) at org.dspace.statistics.util.StatisticsImporter.main(StatisticsImporter.java:470) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:194) --Dale --- Dale Poulter Automation Coordinator Library Information Technology Services Vanderbilt University Suite 700 110 21st Avenue South Nashville, TN 37240 (615)343-5388 (615)343-8834 (fax) (615)207-9705 (cell) dale.poul...@vanderbilt.edumailto:dale.poul...@vanderbilt.edu -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics in 1.6
Hi Dale, What do you have set in dspace.cfg for 'solr.log.server'? Hopefully it will be something like: '${dspace.baseURL}/solr/statistics'? Assuming it is: i) Have you installed the 'solr' webapp as 'solr' (some people rename their webapps) ii) What setting doyou have in dspace.cfg for dspace.baseUrl? Thanks, Stuart From: Poulter, Dale [dale.poul...@vanderbilt.edu] Sent: Saturday, 6 March 2010 1:38 p.m. To: Dspace-tech@lists.sourceforge.net Subject: [Dspace-tech] Statistics in 1.6 Good evening all, We have been able to successfully install 1.6 and the system seems to be working great so far. However, after we successfully converted the old logs we have been unable to import the new logs. After several attempts, we regularly get the error below. Any suggestions as to the cause? Thanks, bash-3.00# ./dspace stats-log-importer -i /dspace/newlog/dspace.log -m Exception: null java.net.MalformedURLException at java.net.URL.init(URL.java:601) at java.net.URL.init(URL.java:464) at java.net.URL.init(URL.java:413) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.init(CommonsHttpSolrServer.java:97) at org.dspace.statistics.util.StatisticsImporter.main(StatisticsImporter.java:470) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:194) --Dale --- Dale Poulter Automation Coordinator Library Information Technology Services Vanderbilt University Suite 700 110 21st Avenue South Nashville, TN 37240 (615)343-5388 (615)343-8834 (fax) (615)207-9705 (cell) dale.poul...@vanderbilt.edumailto:dale.poul...@vanderbilt.edu -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics for 1.5.2 xmlui
After conferring with a colleague I have determined that since dspace is mounted with apache in my configuration as its front end that I am going to use the apache logs and something like awstats. -Original Message- From: Sobieralski, Damian Michael Sent: Monday, February 01, 2010 4:37 PM To: 'dspace-tech@lists.sourceforge.net' Subject: Statistics for 1.5.2 xmlui Hello group, I am running dspace 1.5.2. First off, I already realize that in 1.6 a better/easier method for generating statistics will be available - http://wiki.dspace.org/index.php/Statistical_Improvements_for_v1.6 But I cannot wait for 1.6 to come out. I need to obtain some statistics for an end of year paper report for my job with a deadline in like 2 weeks (though the sooner I harvest this data the better). So this isn't needed right now on a regular basis. It is just needed for this report. I am a developer so I have no apprehension querying text files and/or a database. But I could not find any documentation on where dspace stores the information that I need. Is it all stored in the dspace.log, the database (which tables?) or something else? What I am looking to gather are statistics like: 1) the number of hits the system gets (yearly and monthly) 2) Country breakdown - I just want to know how many different countries are using it, and if possible with a list of all of them. I'm guessing if I could get the ips that were logged I could query dns to get the countries here. As I said, I'm happy to write something to query/parse the data that I need. But I want to make sure that I am going to the correct place(s) for this information. Could anyone share with me where exactly I would obtain this data or supply me with a hyperlink where this is documented? Thanks in advance. - Damian -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics for 1.5.2 xmlui
Hello group, I am running dspace 1.5.2. First off, I already realize that in 1.6 a better/easier method for generating statistics will be available - http://wiki.dspace.org/index.php/Statistical_Improvements_for_v1.6 But I cannot wait for 1.6 to come out. I need to obtain some statistics for an end of year paper report for my job with a deadline in like 2 weeks (though the sooner I harvest this data the better). So this isn't needed right now on a regular basis. It is just needed for this report. I am a developer so I have no apprehension querying text files and/or a database. But I could not find any documentation on where dspace stores the information that I need. Is it all stored in the dspace.log, the database (which tables?) or something else? What I am looking to gather are statistics like: 1) the number of hits the system gets (yearly and monthly) 2) Country breakdown - I just want to know how many different countries are using it, and if possible with a list of all of them. I'm guessing if I could get the ips that were logged I could query dns to get the countries here. As I said, I'm happy to write something to query/parse the data that I need. But I want to make sure that I am going to the correct place(s) for this information. Could anyone share with me where exactly I would obtain this data or supply me with a hyperlink where this is documented? Thanks in advance. - Damian -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics general report
Hi Gary, Running 1.5.2 jspui, it has been noted that our general stats report is not working as it ought. Today, for example, is is displaying only data from 28th December 2009 until now. Normally this would be showing data from the beginning of 2007 to the present day. What do I need to check as far as the logs and generated .dat files or .html report files go? Each time your run the stats scripts, the dspace.log.* files are read, and generate the .dat files. THe .dat files are then converted to the .html files. S it sounds like something may have happened to some of your older .log files. We have recognised the current log handling methods (by default only keeping 500 x 1mb log files, then deleting older log files) as not as good as it could be, so have addressed this in 1.6 with a change to use date-stamped log files that don't (by default) get deleted. Thanks, Stuart Lewis IT Innovations Analyst and Developer Te Tumu Herenga The University of Auckland Library Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand Ph: 64 9 373-7599 x81928 http://www.library.auckland.ac.nz/ -- Throughout its 18-year history, RSA Conference consistently attracts the world's best and brightest in the field, creating opportunities for Conference attendees to learn about information security's most important issues through interactions with peers, luminaries and emerging and established companies. http://p.sf.net/sfu/rsaconf-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics general report
Hi all, Running 1.5.2 jspui, it has been noted that our general stats report is not working as it ought. Today, for example, is is displaying only data from 28th December 2009 until now. Normally this would be showing data from the beginning of 2007 to the present day. What do I need to check as far as the logs and generated .dat files or .html report files go? Thanks Gary GARY BROWNE | Development Programmer Library IT Services | University Library THE UNIVERSITY OF SYDNEY Level 1, Fisher Library F03 | The University of Sydney | NSW | 2006 T +61 2 9351 5946 | F +61 2 9036 E gary.bro...@sydney.edu.au | W http://sydney.edu.au Sent from my plain old desktop computer. CRICOS 00026A This email plus any attachments to it are confidential. Any unauthorised use is strictly prohibited. If you receive this email in error, please delete it and any attachments. Please think of our environment and only print this e-mail if necessary. -- Throughout its 18-year history, RSA Conference consistently attracts the world's best and brightest in the field, creating opportunities for Conference attendees to learn about information security's most important issues through interactions with peers, luminaries and emerging and established companies. http://p.sf.net/sfu/rsaconf-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics
One note I would like to add about the installation though: In Step 4: Rebuild and deploy DSpace code If your method of installation requires you to modify /dspace/config/dspace.cfg, and you need to copy a folder. If you're using subversion or other source control management, I would recommend that you realize you need to svn export the folder, instead of just cp. Otherwise you'll copy .svn files which will sort of contaminate your $dspace_bin Secondly, I've fixed my database issue with stats aggregating. 10:46:40 Aggregating stats.view_metadata_month Database error: ERROR: value too long for type character varying(200) I've debug'ed our system, and found that some fields had values larger than 200 chars, so I had to modify our database/install script so that the fields can be 255 chars. I had to do that to the view_metadata_... and download_metadata_... tables. Six in total. -- Peter Dietz OSU Libraries - Systems Developer/Engineer 614.441.8182 - dietz...@osu.edu -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics
Hi I am intending to setup statistics on dspace1.5.2, can anyone help on how to do that. Regards, Lewatle htmlpfont face = verdana size = 0.8 color = navyThis communication is intended for the addressee only. It is confidential. If you have received this communication in error, please notify us immediately and destroy the original message. You may not copy or disseminate this communication without the permission of the University. Only authorized signatories are competent to enter into agreements on behalf of the University and recipients are thus advised that the content of this message may not be legally binding on the University and may contain the personal views and opinions of the author, which are not necessarily the views and opinions of The University of the Witwatersrand, Johannesburg. All agreements between the University and outsiders are subject to South African Law unless the University agrees in writing to the contrary./font/p/html -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics
Lewatle, The guide I followed was from http://wiki.dspace.org/index.php/StatisticsAddOn http://wiki.dspace.org/index.php/StatisticsAddOnSpecifically: Media:stats-addon-2.1.2.ziphttp://wiki.dspace.org/static_files/1/12/Stats-addon-2.1.2.zip - Version 2.1.2, for DSpace 1.5.2 (as a Patch) In that file is a docs folder that has step by step instructions. The only steps that gave me some issues were the patching step (patch -p0 -i ../stats-addon-2.1.2/patch/minhostats212to152-patch) which is because our code has local modifications, and the post-installation crontasks. For the crontab I'm currently omitting the psql half of the command. I will admit my installation is not finished, as the stats-aggregate command fails out with 10:46:40 Aggregating stats.view_item_coll_month 10:46:40 Aggregating stats.view_metadata_month Database error: ERROR: value too long for type character varying(200) On Tue, Oct 27, 2009 at 5:49 AM, Lewatle Phaladi lewatle.phal...@wits.ac.za wrote: Hi I am intending to setup statistics on dspace1.5.2, can anyone help on how to do that. Regards, Lewatle This communication is intended for the addressee only. It is confidential. If you have received this communication in error, please notify us immediately and destroy the original message. You may not copy or disseminate this communication without the permission of the University. Only authorized signatories are competent to enter into agreements on behalf of the University and recipients are thus advised that the content of this message may not be legally binding on the University and may contain the personal views and opinions of the author, which are not necessarily the views and opinions of The University of the Witwatersrand, Johannesburg. All agreements between the University and outsiders are subject to South African Law unless the University agrees in writing to the contrary. -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Peter Dietz OSU Libraries - Systems Developer/Engineer 614.441.8182 - dietz...@osu.edu -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics AddOn cron task
I'm having an issue with getting the final step of the Statistics Addon from UMinho for Dspace 1.5.2 working. That is crontab to aggregate the statistics. I have my crontab set to run (for testing, every minute) the stats aggregation command. And I'm not seeing any results. Wondering what the issue was, I've tried to just run that same command at a terminal, and it gives me errors as postgres tries to parse the file. bash-3.2$ psql -f /dspace/bin/stats-aggregate psql:/dspace/bin/stats-aggregate:51: ERROR: syntax error at or near #!/ at character 1 psql:/dspace/bin/stats-aggregate:51: LINE 1: #!/bin/sh psql:/dspace/bin/stats-aggregate:51: ^ bash-3.2$ psql -f /dspace/bin/stats-aggregate -c -a ERROR: syntax error at or near - at character 1 LINE 1: -a ^ Any help would be most appreciated. -- Peter Dietz OSU Libraries - Systems Developer/Engineer 614.441.8182 - dietz...@osu.edu -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics AddOn cron task
I've noticed that psql doesn't like input of shell script files (it wants .sql like files). So just plain running these commands from the terminal, (without the [pgsql bin]/psql -f) works fine, and I am now getting data. On Mon, Oct 26, 2009 at 11:57 AM, Peter Dietz dietz...@osu.edu wrote: I'm having an issue with getting the final step of the Statistics Addon from UMinho for Dspace 1.5.2 working. That is crontab to aggregate the statistics. I have my crontab set to run (for testing, every minute) the stats aggregation command. And I'm not seeing any results. Wondering what the issue was, I've tried to just run that same command at a terminal, and it gives me errors as postgres tries to parse the file. bash-3.2$ psql -f /dspace/bin/stats-aggregate psql:/dspace/bin/stats-aggregate:51: ERROR: syntax error at or near #!/ at character 1 psql:/dspace/bin/stats-aggregate:51: LINE 1: #!/bin/sh psql:/dspace/bin/stats-aggregate:51: ^ bash-3.2$ psql -f /dspace/bin/stats-aggregate -c -a ERROR: syntax error at or near - at character 1 LINE 1: -a ^ Any help would be most appreciated. -- Peter Dietz OSU Libraries - Systems Developer/Engineer 614.441.8182 - dietz...@osu.edu -- Peter Dietz OSU Libraries - Systems Developer/Engineer 614.441.8182 - dietz...@osu.edu -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics: General Statistics
Is there any way to create a general statistics report from monthly reports? My log files looped in 2009-09 so now my general stats are only from then. I'd really like to have general stats from the start of the repository if this is possible. My monthly stats are still intact. Sean -- Sean Carte esAL Library Systems Manager +27 72 898 8775 +27 31 373 2490 fax: 0866741254 http://esal.dut.ac.za/ -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics - monthly reports
Hi We just started running our statistics (v1.5) and found that the monthly reports contain zero values for all type of statistics, except All Items. Only the most recent general report contains some values. How do we get all the previous monthly reports to show the statistics? TIA, Yuyun NIE Library, Singapore National Institute of Education (Singapore) http://www.nie.edu.sg DISCLAIMER : The information contained in this email, including any attachments, may contain confidential information. This email is intended only for the use of the addressee(s) listed above. Unauthorised sight, dissemination or any other use of the information contained in this email is strictly prohibited. If you have received this email by fault, please notify the sender and delete it immediately. -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics in DSpace
Hi... As much as I hate to say this...I'm confused ;-) A few weeks ago we switched from running DSpace 1.4.2 to DSpace 1.5.2 On September 30th, I ran my regular stats job: 0 11 * * * /dspace/dspace/bin/stat-general /dev/null 21 30 11 * * * /dspace/dspace/bin/stat-monthly /dev/null 21 45 11 * * * /dspace/dspace/bin/stat-report-general /dev/null 21 55 11 * * * /dspace/dspace/bin/stat-report-monthly /dev/null 21 What I ended up was a report that claimed to be from September 1 - September 30th, but actually it appears to only have the data for September 30th. All the stats numbers are really low. I thought to re-run it, but discovered that the dspace log files had been deleted. Do the new stats programs delete the log files they use? Any help anyone could give me would be great. Stats are very important at our site and it looks like I lost the data for September. P.S. Does the statistics program remove robots from the counts? I thought it did, but I couldn't find anything in the code that indicated it. -- *** George Kozak Digital Library Specialist Division of Library Information Technologies (DLIT), Digital Media Group 501 Olin Library Cornell University 607-255-8924 *** g...@cornell.edu -- Come build with us! The BlackBerryreg; Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9#45;12, 2009. Register now#33; http://p.sf.net/sfu/devconf ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics in Dspace 1.5.2 xmlui version
Dear group I need some help in calculating the number of articles in each collection and displaying it against the collection name in the home page so that users can easily identify if there is something in that collection or not before even clicking on the collection for example Choose a community to browse its collections. Academic Services http://spiral.imperial.ac.uk/handle/10044/1/489 [2] Administrative Services http://spiral.imperial.ac.uk/handle/10044/1/491 [3] Faculty of Engineering http://spiral.imperial.ac.uk/handle/10044/1/1 [754] Faculty of Medicine http://spiral.imperial.ac.uk/handle/10044/1/9 [75] Faculty of Natural Sciences http://spiral.imperial.ac.uk/handle/10044/1/7 [653] Humanities http://spiral.imperial.ac.uk/handle/10044/1/1197 [17] Imperial College Business School http://spiral.imperial.ac.uk/handle/10044/1/643 [1216] Thank you Kind regards Maitumelo Morupisi University of Botswana -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics in Dspace 1.5.2 xmlui version
In your dspace.cfg, find a line: webui.strengths.show = false Change it into true. The item count will be displayed. Allen. HKU Hub Administrator, http://hub.hku.hk Morupisi, Maitumelo wrote: Dear group I need some help in calculating the number of articles in each collection and displaying it against the collection name in the home page so that users can easily identify if there is something in that collection or not before even clicking on the collection for example Choose a community to browse its collections. Academic Services http://spiral.imperial.ac.uk/handle/10044/1/489 [2] Administrative Services http://spiral.imperial.ac.uk/handle/10044/1/491 [3] Faculty of Engineering http://spiral.imperial.ac.uk/handle/10044/1/1 [754] Faculty of Medicine http://spiral.imperial.ac.uk/handle/10044/1/9 [75] Faculty of Natural Sciences http://spiral.imperial.ac.uk/handle/10044/1/7 [653] Humanities http://spiral.imperial.ac.uk/handle/10044/1/1197 [17] Imperial College Business School http://spiral.imperial.ac.uk/handle/10044/1/643 [1216] Thank you Kind regards Maitumelo Morupisi University of Botswana -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Statistics in Dspace 1.5.2 xmlui version
Thank you but there is this comment though I have set it to true and started tomcat but still it does not show. It talked about creating themes for xmlui. whether to display collection and community strengths # (This configuration is not used by XMLUI. To show strengths in the # XMLUI, you just need to create a theme which displays them) webui.strengths.show = true -Original Message- From: dspace-tech-requ...@lists.sourceforge.net [mailto:dspace-tech-requ...@lists.sourceforge.net] Sent: Wednesday, June 17, 2009 11:23 AM To: dspace-tech@lists.sourceforge.net Subject: DSpace-tech Digest, Vol 38, Issue 41 Send DSpace-tech mailing list submissions to dspace-tech@lists.sourceforge.net To subscribe or unsubscribe via the World Wide Web, visit https://lists.sourceforge.net/lists/listinfo/dspace-tech or, via email, send a message with subject or body 'help' to dspace-tech-requ...@lists.sourceforge.net You can reach the person managing the list at dspace-tech-ow...@lists.sourceforge.net When replying, please edit your Subject line so it is more specific than Re: Contents of DSpace-tech digest... Today's Topics: 1. Re: Statistics in Dspace 1.5.2 xmlui version (Allen Lam) 2. Re: DSpace search weirdness (mikan.d.dspace listmail) 3. DSpace Versions Compatability (Dr. Ahmad Al-Zubi) 4. Can we change the layout posistions of dspace in jspui (Yureshwar Dspace) 5. Re: Change Default Layout IN JSPUI (hardik mishra) -- Message: 1 Date: Wed, 17 Jun 2009 15:24:21 +0800 From: Allen Lam allen.dsp...@gmail.com Subject: Re: [Dspace-tech] Statistics in Dspace 1.5.2 xmlui version To: dspace-tech@lists.sourceforge.net Message-ID: 4a389a25.7080...@gmail.com Content-Type: text/plain; charset=ISO-8859-1; format=flowed In your dspace.cfg, find a line: webui.strengths.show = false Change it into true. The item count will be displayed. Allen. HKU Hub Administrator, http://hub.hku.hk Morupisi, Maitumelo wrote: Dear group I need some help in calculating the number of articles in each collection and displaying it against the collection name in the home page so that users can easily identify if there is something in that collection or not before even clicking on the collection for example Choose a community to browse its collections. Academic Services http://spiral.imperial.ac.uk/handle/10044/1/489 [2] Administrative Services http://spiral.imperial.ac.uk/handle/10044/1/491 [3] Faculty of Engineering http://spiral.imperial.ac.uk/handle/10044/1/1 [754] Faculty of Medicine http://spiral.imperial.ac.uk/handle/10044/1/9 [75] Faculty of Natural Sciences http://spiral.imperial.ac.uk/handle/10044/1/7 [653] Humanities http://spiral.imperial.ac.uk/handle/10044/1/1197 [17] Imperial College Business School http://spiral.imperial.ac.uk/handle/10044/1/643 [1216] Thank you Kind regards Maitumelo Morupisi University of Botswana -- Message: 2 Date: Wed, 17 Jun 2009 10:49:22 +0300 From: mikan.d.dspace listmail mikan.dsp...@gmail.com Subject: Re: [Dspace-tech] DSpace search weirdness To: bill.ander...@library.gatech.edu Cc: Dspace Tech dspace-tech@lists.sourceforge.net Message-ID: 417313850906170049i37d166bfoe8aaf5d6f5f5b...@mail.gmail.com Content-Type: text/plain; charset=ISO-8859-1 Hi Bill, You have got it right. I cloned the new DSpace instance roughly by: 1. first doing a fresh install of DSpace source 2. Importing database dump from the other server (taken with pg_dump, I also tried pg_restore btw.) 3. I created assetstore.tar.gz from my old server and copied it to the new server. When I run media-filter or media-filter --force, the extracted text doesnt get the special characters (say ?, ?, ?) right, but has '?' -mark instead of them. On my original server everything works fine. And on my new server, the new submissions work fine after filter-media. I just re-ran filter-media -f and no error messages come up. Maybe I should dig the assetstore to see what the files look like from the command line? How could I find out the assetstore path for a specific item? Thanks, Mika 2009/6/16 bill.ander...@library.gatech.edu: Correct me if I don't have this right: ?you had an existing instance of dspace, where search worked properly. ?You cloned the instance to new server, and after the transfer, media filter wasn't able to extract full text properly from PDFs with special characters in them. ?When you re-submit the PDFs to the new instance, media filter (and thus search) works as it should? It's possible the pdfs were damaged in the transfer. ?How did you transfer them? I assume you're not seeing any errors in the media filter output, right? Cheers, Bill Bill Anderson Software Developer Digital Library Development Georgia Tech Library - mikan.d.dspace listmail mikan.dsp...@gmail.com
[Dspace-tech] Statistics error?
Hello again, I have a question? When I start DSpace's statistics this error show me. [r...@localhost bin]# ./stat-initial Exception in thread main org.postgresql.util.PSQLException: ERROR: syntax error at or near FROM at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1512) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1297) at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:188) at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:430) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:346) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2Statement.java:250) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:92) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:92) at org.dspace.storage.rdbms.DatabaseManager.query(DatabaseManager.java:209) at org.dspace.storage.rdbms.DatabaseManager.querySingle(DatabaseManager.java:279) at org.dspace.app.statistics.LogAnalyser.getNumItems(LogAnalyser.java:1273) at org.dspace.app.statistics.LogAnalyser.getNumItems(LogAnalyser.java:1302) at org.dspace.app.statistics.LogAnalyser.processLogs(LogAnalyser.java:543) at org.dspace.app.statistics.CreateStatReport.statInitial(CreateStatReport.java:291) at org.dspace.app.statistics.CreateStatReport.main(CreateStatReport.java:162) [r...@localhost bin]# Can you advice me? Best regard, Zoloo -- Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM) software. With Adobe AIR, Ajax developers can use existing skills and code to build responsive, highly engaging applications that combine the power of local resources and data with the reach of the web. Download the Adobe AIR SDK and Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics error?
Hi Zaya, It might be easier to track this problem down with debug-level logging. To do this, edit your [dspace]/config/log4j.properties and change log4j.rootCategory=INFO, A1 to log4j.rootCategory=DEBUG, A1. Then restart Dspace. Now you’ll be able to see all the SQL queries in your log, which should shed some more light on why the one being used by stat-initial is upsetting PostgreSQL. Cheers, Kim From: Zaya Kh [mailto:zayak...@gmail.com] Sent: Wednesday, 4 February 2009 1:23 a.m. To: dspace-tech Subject: [Dspace-tech] Statistics error? Hello again, I have a question? When I start DSpace's statistics this error show me. [r...@localhost bin]# ./stat-initial Exception in thread main org.postgresql.util.PSQLException: ERROR: syntax error at or near FROM at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1512) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1297) at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:188) at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:430) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:346) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2Statement.java:250) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:92) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:92) at org.dspace.storage.rdbms.DatabaseManager.query(DatabaseManager.java:209) at org.dspace.storage.rdbms.DatabaseManager.querySingle(DatabaseManager.java:279) at org.dspace.app.statistics.LogAnalyser.getNumItems(LogAnalyser.java:1273) at org.dspace.app.statistics.LogAnalyser.getNumItems(LogAnalyser.java:1302) at org.dspace.app.statistics.LogAnalyser.processLogs(LogAnalyser.java:543) at org.dspace.app.statistics.CreateStatReport.statInitial(CreateStatReport.java:291) at org.dspace.app.statistics.CreateStatReport.main(CreateStatReport.java:162) [r...@localhost bin]# Can you advice me? Best regard, Zoloo -- Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM) software. With Adobe AIR, Ajax developers can use existing skills and code to build responsive, highly engaging applications that combine the power of local resources and data with the reach of the web. Download the Adobe AIR SDK and Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Statistics error?
Hi Zaya, It is bug http://sourceforge.net/tracker/index.php?func=detailaid=1931799group_i d=19984atid=119984 which have been fixed. Regards, YinYin From: Zaya Kh [mailto:zayak...@gmail.com] Sent: Wednesday, 4 February 2009 1:23 a.m. To: dspace-tech Subject: [Dspace-tech] Statistics error? Hello again, I have a question? When I start DSpace's statistics this error show me. [r...@localhost bin]# ./stat-initial Exception in thread main org.postgresql.util.PSQLException: ERROR: syntax error at or near FROM at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecu torImpl.java:1512) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImp l.java:1297) at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java: 188) at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Stateme nt.java:430) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdb c2Statement.java:346) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2St atement.java:250) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(Delegat ingPreparedStatement.java:92) at org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(Delegat ingPreparedStatement.java:92) at org.dspace.storage.rdbms.DatabaseManager.query(DatabaseManager.java:209) at org.dspace.storage.rdbms.DatabaseManager.querySingle(DatabaseManager.jav a:279) at org.dspace.app.statistics.LogAnalyser.getNumItems(LogAnalyser.java:1273) at org.dspace.app.statistics.LogAnalyser.getNumItems(LogAnalyser.java:1302) at org.dspace.app.statistics.LogAnalyser.processLogs(LogAnalyser.java:543) at org.dspace.app.statistics.CreateStatReport.statInitial(CreateStatReport. java:291) at org.dspace.app.statistics.CreateStatReport.main(CreateStatReport.java:16 2) [r...@localhost bin]# Can you advice me? Best regard, Zoloo -- next part -- An HTML attachment was scrubbed... -- -- Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM) software. With Adobe AIR, Ajax developers can use existing skills and code to build responsive, highly engaging applications that combine the power of local resources and data with the reach of the web. Download the Adobe AIR SDK and Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] STATISTICS
Hai All, I have a question! How we can produce statistics or report from dspace?? Can u guide me for this issue. Hope u all can help. Many thanks. This e-mail and the attachments are intended solely for the person to whom it has been addressed. It contains privileged and/or confidential information and is privileged or otherwise protected from disclosure. If you are not the person for whom this e-mail was intended, or the e-mail has reached you by mistake, please delete it immediately and inform us of the error. Our e-mail address is administra...@uniten.edu.my. All opinions, conclusions and other information in this message that do not relate to the official business of Universiti Tenaga Nasional (UNITEN) shall be understood as neither given nor endorsed by UNITEN. UNITEN shall not be responsible for any activity that may be considered as illegal and/or improper use of e-mail and UNITEN further is claims and shall not accept liability for any content of this e-mail, or for the consequences of any actions taken on the basis of the information provided, unless that information is subsequently confirmed in writing. WARNING Internet communications cannot be guaranteed to be secured or error-free as information could be intercepted, corrupted, lost, arrive late or contain viruses. As such, we do not accept liability for any errors or omissions in the content of this message which may arise as a result of internet transmission. UNITEN does not authorize any of its employees to make any defamatory or seditious statements or commit any offence which is contrary to the laws of Malaysia. Any such communications and/or actions by such employees are outside the scope of employment of the said individuals and UNITEN shall not be liable for such communications and/or actions. -- Create and Deploy Rich Internet Apps outside the browser with Adobe(R)AIR(TM) software. With Adobe AIR, Ajax developers can use existing skills and code to build responsive, highly engaging applications that combine the power of local resources and data with the reach of the web. Download the Adobe AIR SDK and Ajax docs to start building applications today-http://p.sf.net/sfu/adobe-com___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech