Hi Francis, Try this: 1. Stop the traffic to your repository but leave Tomcat running. Then take of copy of the /dspace/solr/statistics/data/index directory while Tomcat is running to /dspace/statistics-backup/index (not sure if this is really necessary). 2. Run the following command on that copy: java -cp /dspace/webapps/solr/WEB-INF/lib/lucene-core-4.10.2.jar -ea:org.apache.lucene... org.apache.lucene.index.CheckIndex /dspace/statistics-backup/index -fix 3. This will run for a while and needs a lot of disk space. You need at least the size of the statistics core as free disk space. 4. Once the CheckIndex tool is ready and repaired the index.Stop Tomcat again and move the repaired index (in /dspace/statistics-backup/index) to the SOLR statistics directory (/dspace/solr/statistics/data/index)
The CheckIndex tool will report how many records are lost when repairing the index. There is no way to restore them. Best regards, Tom [image: logo] Tom Desair 250-B Suite 3A, Lucius Gordon Drive, West Henrietta, NY 14586 Gaston Geenslaan 14, Leuven 3001, Belgium www.atmire.com <http://atmire.com/website/?q=services&utm_source=emailfooter&utm_medium=email&utm_campaign=tomdesair> 2017-10-26 15:16 GMT+02:00 Francis Brouns <[email protected]>: > Hi all, > > since we are being flooded by search requests, several SOLR errors started > occuring. These errors occurs both in search and statistics and it seems > like these got corrupted. If I understand the manual correctly, the search > solr index will repair itself because we enabled the respective cron tabs. > Is there a way to repair the statistics index? > > - Error opening new searcher Caused by: java.io.IOException: Map failed > - java.io.IOException: Map failed: statistics/data/index/_1p90_ > Lucene410_0.dvd > - auto commit error...:java.io.IOException: Map failed: > > The files referenced in the log files (e.g./dspace/solr/statistics/ > data/index/_1p90_Lucene410_0.dvd) do exist and have the correct > permissions. > > Running DSpace 5.4, solr statistics, jspui, tomcat 7, java 7, Sles Linux, > Oracle. > > kind regards, > Francis Brouns > > > Errors thrown are: > 2017-10-19 00:30:59,054 ERROR org.apache.solr.core.SolrCore @ > org.apache.solr.common.SolrException: Error opening new searcher > at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1565) > ... > Caused by: java.io.IOException: Map failed: MMapIndexInput(path="/dspace/ > solr/search/data/index/_ggq.fdt") [this may be caused by lack of enough > unfragmented virtual address space or too restrictive virtual memory limits > enforced by the operating system, preventing us to map a chunk of 623947081 > bytes. Please review 'ulimit -v', 'ulimit -m' (both should return > 'unlimited'), and 'sysctl vm.max_map_count'. More information: > http://blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory-on-64bit.html] > at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:888) > at org.apache.lucene.store.MMapDirectory.map(MMapDirectory.java:224) > > > > > 2017-10-19 01:31:09,769 ERROR org.apache.solr.core.SolrCore @ > java.io.IOException: Map failed: MMapIndexInput(path="/dspace/ > solr/statistics/data/index/_1osu_Lucene410_0.dvd") [this may be caused by > lack of enough unfragmented virtual address space or too restrictive > virtual memory limits enforced by the operating system, preventing us to > map a chunk of 303329851 bytes. Please review 'ulimit -v', 'ulimit -m' > (both should return 'unlimited'), and 'sysctl vm.max_map_count'. More > information: http://blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory- > on-64bit.html] > at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:888) > at org.apache.lucene.store.MMapDirectory.map(MMapDirectory.java:224) > at org.apache.lucene.store.MMapDirectory.openInput(MMapDirectory.java:199) > > > 2017-10-26 01:45:11,641 INFO org.apache.solr.update.UpdateHandler @ > start commit{,optimize=false,openSearcher=true,waitSearcher=true, > expungeDeletes=false,softCommit=false,prepareCommit=false} > 2017-10-26 01:45:12,418 ERROR org.apache.solr.update.CommitTracker @ auto > commit error...:java.io.IOException: Map failed: > MMapIndexInput(path="/dspace/solr/statistics/data/index/_1p90_Lucene410_0.dvd") > [this may be caused by lack of enough unfragmented virtual address space or > too restrictive virtual memory limits enforced by the operating system, > preventing us to map a chunk of 305990079 bytes. Please review 'ulimit -v', > 'ulimit -m' (both should return 'unlimited'), and 'sysctl > vm.max_map_count'. More information: http://blog.thetaphi.de/2012/ > 07/use-lucenes-mmapdirectory-on-64bit.html] > at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:888) > at org.apache.lucene.store.MMapDirectory.map(MMapDirectory.java:224) > at org.apache.lucene.store.MMapDirectory.openInput(MMapDirectory.java:199) > at org.apache.lucene.store.NRTCachingDirectory.openInput( > NRTCachingDirectory.java:198) > at org.apache.lucene.codecs.lucene410.Lucene410DocValuesProducer.<init>( > Lucene410DocValuesProducer.java:121) > at org.apache.lucene.codecs.lucene410.Lucene410DocValuesFormat. > fieldsProducer(Lucene410DocValuesFormat.java:181) > at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$ > FieldsReader.<init>(PerFieldDocValuesFormat.java:238) > > > > -- > You received this message because you are subscribed to the Google Groups > "DSpace Technical Support" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at https://groups.google.com/group/dspace-tech. > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/dspace-tech. For more options, visit https://groups.google.com/d/optout.
