Hi Hilton,
Yes, the first thing that we thought is the filtering of bots had been
improved and now the number of statistics has been reduced because of
this(the theory that many of old visits are from bots) , but how to
explain the big increase of visits in one of the communities?
On 04/06/15 17:44, Hilton Gibson wrote:
Hi Ruben
Same thing happened to me:
http://scholar.sun.ac.za/handle/10019.1/1/statistics
I can only assume that bot filtering has improved?
Cheers
hg
*Hilton Gibson*
Ubuntu Linux Systems Administrator
Stellenbosch University Library
http://staff.lib.sun.ac.za/~hgibson/docs/cv/cv.html
<http://staff.lib.sun.ac.za/%7Ehgibson/docs/cv/cv.html>
On 4 June 2015 at 17:28, Ruben <ruben.bo...@csuc.cat
<mailto:ruben.bo...@csuc.cat>> wrote:
Hi Tim,
I didn't do the second step, reindexing Solr Stats. Now I did it and
although the stats looks more completely (appears city and country
data)
the number of visits still the same. Also it's curious in many
cases the
statistics seems completely different. For example, in one
community the
number of visits in December 2014 is 0 in the old DSpace, and
after the
upgrade appears 10 visits, changing the total visits from 1134 to
22620.
The most curious thing is the appearance of Palo Alto in all of "Top
cities views" lists, and before the upgrade didn't appear in any list.
The only thing can I do is list the steps that I did and wait if
anyone
can review them:
1.- Copy [dspace]/solr/statistics from old MV to the new.
2.- wget
"http://search.maven.org/remotecontent?filepath=org/apache/lucene/lucene-core/3.5.0/lucene-core-3.5.0.jar"
-O lucene-core-3.5.0.jar
3.- java -cp lucene-core-3.5.0.jar
org.apache.lucene.index.IndexUpgrader
statistics/data/index/
4.- Move previous upgraded statistics/data to
[dspace-src]/dspace/solr/statistics/
5.- mvn package
6.- ant update
7.- [dspace]/bin/dspace solr-reindex-statistics
Thanks
On 04/06/15 15:43, Tim Donohue wrote:
> Hi Rubén,
>
> Have you reindexed your Solr Stats after upgrading? See step #13
in the
> "Upgrading DSpace" documentation:
>
> https://wiki.duraspace.org/display/DSDOC5x/Upgrading+DSpace
>
> There are two steps to actually upgrading Solr Statistics.
>
> 1) The first part it to just upgrade the indexes (to the latest Solr
> version). This part is performed automatically by default (but
if the
> automated version has errors, there are those "Manually
Upgrading Solr
> Indexes" instructions.
>
> 2) After the Solr indexes are in the latest version, you ALSO
need to
> perform an "in-place" reindex. This ensures that the structure
(schema)
> within your Solr index is updated to how DSpace now stores
statistics.
> If this is skipped, DSpace may not be able to "read" all the
statistical
> data successfully, and so it may only display a portion of the
data that
> is actually within your index.
>
> I hope that helps. But, let us know if you run into further
issues. If
> you have already performed both of these changes, I'd also
encourage you
> to check your DSpace & Tomcat logs to see if any errors are
being reported.
>
> Tim
>
> On 6/4/2015 3:58 AM, Ruben wrote:
>> Hi all,
>>
>> I'm working on dspace upgrade from 1.6 to 5.2, and one of sensible
>> points is the migration of statistics. I've been reading about the
>> necessity of upgrade the indexes to the last Solr version, and I've
>> found this tutorial to do this:
>>
https://wiki.duraspace.org/display/DSDOC5x/Upgrading+DSpace#UpgradingDSpace-ManuallyUpgradingSolrIndexes
>>
>> I've followed the steps of this guide and finally I got the
statistics
>> from 1.7 working on 5.2, but many of them are lost. For
example, one of
>> the communities have 317.110 views in the old DSpace and now
this number
>> is reduced to 100335, and all the convert process seemswell done.
>> Someone have found the same issue with this process or knows a
better
>> tutorial to do this? I'm worried about this because this is one
of the
>> most important requirements, preserve the old statistics.
>>
>> Thanks in advance for your help,
>>
>> Rubén
>>
<https://wiki.duraspace.org/display/DSDOC5x/Upgrading+DSpace#UpgradingDSpace-ManuallyUpgradingSolrIndexes>
>>
>>
>> --
>>
........................................................................
>>
>> Rubén Boada
>> Tècnic de Càlcul i Aplicacions
>> Consorci de Serveis Universitaris de Catalunya (CSUC)
>>
>> Gran Capità, 2 (Edifici Nexus)•08034 Barcelona
>> T.93 551 62 13•ruben.bo...@csuc.cat <mailto:ruben.bo...@csuc.cat>
>> www.csuc.cat <http://www.csuc.cat> •Twitter
@CSUC_info•Facebook•Linkedin
>> Subscriu-te al butlletí; (www.csuc.cat/butlleti
<http://www.csuc.cat/butlleti>)
>>
........................................................................
>>
>>
>>
>>
------------------------------------------------------------------------------
>>
>>
>>
>> _______________________________________________
>> DSpace-tech mailing list
>> DSpace-tech@lists.sourceforge.net
<mailto:DSpace-tech@lists.sourceforge.net>
>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>> List Etiquette:
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>>
>
------------------------------------------------------------------------------
> _______________________________________________
> DSpace-tech mailing list
> DSpace-tech@lists.sourceforge.net
<mailto:DSpace-tech@lists.sourceforge.net>
> https://lists.sourceforge.net/lists/listinfo/dspace-tech
> List Etiquette:
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
--
........................................................................
Rubén Boada
Tècnic de Càlcul i Aplicacions
Consorci de Serveis Universitaris de Catalunya (CSUC)
Gran Capità, 2 (Edifici Nexus)•08034 Barcelona
T.93 551 62 13•ruben.bo...@csuc.cat <mailto:ruben.bo...@csuc.cat>
www.csuc.cat <http://www.csuc.cat> •Twitter
@CSUC_info•Facebook•Linkedin
Subscriu-te al butlletí; (www.csuc.cat/butlleti
<http://www.csuc.cat/butlleti>)
........................................................................
------------------------------------------------------------------------------
_______________________________________________
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
<mailto:DSpace-tech@lists.sourceforge.net>
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette:
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
--
........................................................................
Rubén Boada
Tècnic de Càlcul i Aplicacions
Consorci de Serveis Universitaris de Catalunya (CSUC)
Gran Capità, 2 (Edifici Nexus)•08034 Barcelona
T.93 551 62 13•ruben.bo...@csuc.cat
www.csuc.cat •Twitter @CSUC_info•Facebook•Linkedin
Subscriu-te al butlletí; (www.csuc.cat/butlleti)
........................................................................
------------------------------------------------------------------------------
_______________________________________________
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette