Re: [Dspace-tech] DSpace Statistics general report

2007-04-13 Thread Stuart Lewis [sdl]
Hi Gary,

 So can you tell me how the ³Most recent general report² is generated? Are the
 numbers compiled from the dspace-log-general-%DATE%.dat files or the
 dspace-log-monthly-%DATE%.dat files? (Or some other way?)
  
 I take it the ³stat-report-general² generates this report?

Running stat-general creates to relevant .dat file. Running
stat-report-general renders this file into the HTML page you see.

I've had a look at the code, and it appears that running stat-general uses
the .log files, rather than the .dat files to do the analysis. Therefore if
your log files are reaching the limit set in log4j.properties (500) and are
rolling over, then stat-general will be losing data.

So, in a nutshell, the general reports are compiled from the raw .log files.

Have you got backups of the old log files which you can restore (and
renumber), and then increase the log4j.appender.A1.MaxBackupIndex to make
sure you don't lose them again?

Hope this helps,


Stuart
_

Datblygydd Cymwysiadau'r WeWeb Applications Developer
Gwasanaethau Gwybodaeth  Information Services
Prifysgol Cymru Aberystwyth   University of Wales Aberystwyth

E-bost / E-mail: [EMAIL PROTECTED]
 Ffon / Tel: (01970) 622860
_


-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV
___
DSpace-tech mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/dspace-tech


Re: [Dspace-tech] DSpace Statistics general report

2007-04-12 Thread Gary Browne
Thanks Monika

 

So can you tell me how the Most recent general report is generated?
Are the numbers compiled from the dspace-log-general-%DATE%.dat files or
the dspace-log-monthly-%DATE%.dat files? (Or some other way?)

 

I take it the stat-report-general generates this report?

 

Thanks again for your help.

 

Regards

Gary

 

 

Gary Browne
Development Programmer
Library IT Services
University of Sydney
Australia
ph: 61-2-9351 5946 



From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Monika
Mevenkamp
Sent: Thursday, 12 April 2007 10:44 PM
To: Gary Browne
Subject: Re: [Dspace-tech] DSpace Statistics general report

 

Yes the html reports are generated from dat files which are kept in
/dspace/log  by default. 

Yes the log files cycle. So if you do not regularly compute dat files
(where the digested numbers are recorded) you do loose information. 

The reports probably stopped working when you upgraded because the
format of the log messages changed. The upgraded stats scripts/Java
Analyzer could not deal with the 'old' format. In 1.4.1 this was changed
so it can deal with both formats. Although the upgrade should have posed
a problem only for the month when you upgraded from 1.3 to 1.4. 

To figure out what is going on, you need to look at what scripts you are
running each day/night. You should do stat-monthly, stat-general,
stat-report-monthly, and stat-report-general. These update the dat files
for the current month. 

If you ran stat-initial after the upgrade without editing its default
start date (Jan-2005) you may have overwritten *dat files from previous
month for which the log events vanished because the log files rolled
over. 
You may be able to recover these dat files if the /dspace/log directory
is backed up and your sys admin can get  you the old versions. 

Good luck with pursuing the elusive log info 

Monika




On 4/11/07, Gary Browne [EMAIL PROTECTED] wrote:

Hi

 

I'm running DSpace v1.4.1 on RHEL v4.

 

When I upgraded from 1.3.2 last year to 1.4, the stat reports stopped
working. Then I upgraded to 1.4.1 and they are now working again, but
there seem to be a few issues:

 

i) apparently the general report used to generate
stats from day 0 (which was 7/2005) to now. Now the general report seems
to generate stats only for ~ the last 6 months.

ii)   I've noticed the dspace.log files themselves are
cycling and dspace.log.500 gets popped off the end of the logs, so this
could be why. However, I was under the impression the reports were
generated from the .dat files, which seem to be there at least from the
beginning of 2006.

 

The monthly reports are all working fine from July 2005 to the present
day.

 

The powers that be are getting edgy about getting their precious
numbers, so any advice would be much appreciated.

 

Thanks

Gary

 

 

Gary Browne
Development Programmer
Library IT Services
University of Sydney
Australia
ph: 61-2-9351 5946 

 



-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share
your 
opinions on IT  business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDE
V
___
DSpace-tech mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/dspace-tech 




-- 
Monika Mevenkamp 
Georgia Institute of Technology
Library and Information Center
Phone: 404.385.0108 

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___
DSpace-tech mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/dspace-tech


[Dspace-tech] DSpace Statistics general report

2007-04-11 Thread Gary Browne
Hi

 

I'm running DSpace v1.4.1 on RHEL v4.

 

When I upgraded from 1.3.2 last year to 1.4, the stat reports stopped
working. Then I upgraded to 1.4.1 and they are now working again, but
there seem to be a few issues:

 

i) apparently the general report used to generate
stats from day 0 (which was 7/2005) to now. Now the general report seems
to generate stats only for ~ the last 6 months.

ii)   I've noticed the dspace.log files themselves are
cycling and dspace.log.500 gets popped off the end of the logs, so this
could be why. However, I was under the impression the reports were
generated from the .dat files, which seem to be there at least from the
beginning of 2006.

 

The monthly reports are all working fine from July 2005 to the present
day.

 

The powers that be are getting edgy about getting their precious
numbers, so any advice would be much appreciated.

 

Thanks

Gary

 

 

Gary Browne
Development Programmer
Library IT Services
University of Sydney
Australia
ph: 61-2-9351 5946 

 

-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT  business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.phpp=sourceforgeCID=DEVDEV___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech