Hi all,
we are in the process of upgrading our Dspace 1.8.3 server to Dspace 3.2 and
also want to switch to the new statistics module based on Solr. That means that
we need to convert the old logs and import those into Solr. It seems that a
full path needs to be specified for the location of the input log files and the
output. When using relative paths the -m switch does not work. In dspace 1.8.3
a nullpointer exception is returned in the console. When running
stats-log-converter from dspace 3.2, the console does not report any errors.
Console reports that it is loading dspace.cfg and log4j.properties and then
list some of the log files.
However, the dspace log file reports for every file the same file access
problem. That seems to be because the filename of the -o parameter is joint
with the file name of the log, resulting in an invalid path.
The problem is that it does not convert all files. We never have changed
log4j.properties, but nevertheless we have a mix of log files appended with
numbers and files appended with a date. The current 3.2 log4j.properties uses a
DailyFileAppender with log4j.appender.A1.DatePattern=yyyy-MM-dd. Nevertheless
it only seems to read the log files that have a number appended.
I have two questions
How can I get it to convert all log files? Other than copying them all into a
new file. That file would be very large.
When do I need to use the -n parameter? The logs stem from before Dspace 1.5.2
and from Dspace 1.8.x.
This is running on a Linux (SLES) server, Sun java 1.6
For your information I copy below the output of the console and the log file
best wishes, Francis
======= dspace 1.8.3 ==============
When running the same from dspace183 console returns a Nullpointer
tomcat@lnx:/dspace/dspace183/bin> ./dspace stats-log-converter -i
../log/dspace.log.9 -o ../log/solr5.log -m -n
dspace.log.9
About to convert '/dspace/dspace183/bin/../log/dspace.log.9' to
'../log/solr5.login/../log/dspace.log.9'
Exception: null
java.lang.NullPointerException
at
org.dspace.statistics.util.ClassicDSpaceLogConverter.convert(ClassicDSpaceLogConverter.java:234)
at
org.dspace.statistics.util.ClassicDSpaceLogConverter.main(ClassicDSpaceLogConverter.java:365)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183)
the dspace log file reports similar errors as in dspace 3.2, a file access
problem
================ dspace 3.2 ==============
Console log when running stats-log-converter from dspace3.2
tomcat@lnx:/dspace/dspace32/bin> ./dspace stats-log-converter -i
../log/dspace.log.9 -o ../log/solr4.log -m
INFO [main] (DSpaceKernelInit.java:52) - Created new kernel:
DSpaceKernel:org.dspace:name=ee3fea82-9d3a-4cf1-b506-03fbbe162223,type=DSpaceKernel:lastLoad=null:loadTime=0:running=false:kernel=null
INFO [main] (ConfigurationManager.java:1224) - Loading from classloader:
file:/dspace/dspace32/config/dspace.cfg
INFO [main] (ConfigurationManager.java:1224) - Using dspace provided log
configuration (log.init.config)
INFO [main] (ConfigurationManager.java:1224) - Loading:
/dspace/dspace32/config/log4j.properties
dspace.log.9
dspace.log.95
dspace.log.91
dspace.log.93
dspace.log.94
dspace.log.98
dspace.log.92
dspace.log.99
dspace.log.96
dspace.log.90
dspace.log.97
extract from dspace.log for dspace 3.2
2014-01-24 14:47:33,603 ERROR
org.dspace.statistics.util.ClassicDSpaceLogConverter @ File access problem
java.io.FileNotFoundException: solr.logbin/../log/dspace.log.91 (No such file
or directory)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
at java.io.FileOutputStream.<init>(FileOutputStream.java:84)
at java.io.FileWriter.<init>(FileWriter.java:46)
at
org.dspace.statistics.util.ClassicDSpaceLogConverter.convert(ClassicDSpaceLogConverter.java:106)
at
org.dspace.statistics.util.ClassicDSpaceLogConverter.main(ClassicDSpaceLogConverter.java:365)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183
==================
Deze e-mail is uitsluitend bestemd voor de geadresseerde(n). Verstrekking aan
en gebruik door anderen is niet toegestaan. Open Universiteit sluit iedere
aansprakelijkheid uit die voortvloeit uit elektronische verzending. Aan de
inhoud van deze e-mail en/of eventueel toegevoegde bijlagen kunnen geen rechten
worden ontleend.
This e-mail is intended exclusively for the addressee(s), and may not be passed
on to, or made available for use by any person other than the addressee(s).
Open Universiteit rules out any and every liability resulting from any
electronic transmission. No rights may be derived from the contents of this
message.
------------------------------------------------------------------------------
CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk
_______________________________________________
DSpace-tech mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
