Package: solr-tomcat Version: 3.6.2+dfsg-16 Severity: important Dear Maintainer,
After updating tomcat to tomcat9 and solr-tomcat to 3.6.2+dfsg-16, it seems to be having problems writing to its index directory. The problem surfaced when using dovecot to look up messages. Attached is the error from the catalina log. /var/lib/solr/index does look like it has the right permissions: /var/lib/solr/data and /var/lib/solr/data/index are owned by tomcat:tomcat, permissions 770, and tomcat seems to be running as user tomcat. I have verified that I can write to the directory as root, and as such it's not on a read-only filesystem. I have no idea why it fails to write the lock file. 17-Jan-2019 23:27:24.199 INFO [http-nio-8080-exec-6] org.apache.solr.update.processor.LogUpdateProcessor.finish {add=[173976/7e5de009f991854df726000012cf7b9c/md5i]} 0 1002 17-Jan-2019 23:27:24.200 SEVERE [http-nio-8080-exec-6] org.apache.solr.common.SolrException.log org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out: NativeFSLock@/var/lib/solr/data/index/write.lock: java.io.FileNotFoundException: /var/lib/solr/data/index/write.lock (Read-only file system) at org.apache.lucene.store.Lock.obtain(Lock.java:84) at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:1098) at org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:84) at org.apache.solr.update.UpdateHandler.createMainIndexWriter(UpdateHandler.java:101) at org.apache.solr.update.DirectUpdateHandler2.openWriter(DirectUpdateHandler2.java:171) at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:219) at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:61) at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:115) at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:157) at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:79) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:668) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:834) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1417) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: java.io.FileNotFoundException: /var/lib/solr/data/index/write.lock (Read-only file system) at java.base/java.io.RandomAccessFile.open0(Native Method) at java.base/java.io.RandomAccessFile.open(RandomAccessFile.java:345) at java.base/java.io.RandomAccessFile.<init>(RandomAccessFile.java:259) at java.base/java.io.RandomAccessFile.<init>(RandomAccessFile.java:214) at org.apache.lucene.store.NativeFSLock.obtain(NativeFSLockFactory.java:203) at org.apache.lucene.store.Lock.obtain(Lock.java:95) ... 33 more 17-Jan-2019 23:27:24.201 INFO [http-nio-8080-exec-6] org.apache.solr.core.SolrCore.execute [] webapp=/solr path=/update params={} status=500 QTime=1002 17-Jan-2019 23:27:24.201 SEVERE [http-nio-8080-exec-6] org.apache.solr.common.SolrException.log org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out: NativeFSLock@/var/lib/solr/data/index/write.lock: java.io.FileNotFoundException: /var/lib/solr/data/index/write.lock (Read-only file system) at org.apache.lucene.store.Lock.obtain(Lock.java:84) at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:1098) at org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:84) at org.apache.solr.update.UpdateHandler.createMainIndexWriter(UpdateHandler.java:101) at org.apache.solr.update.DirectUpdateHandler2.openWriter(DirectUpdateHandler2.java:171) at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:219) at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:61) at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:115) at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:157) at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:79) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:668) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:834) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1417) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: java.io.FileNotFoundException: /var/lib/solr/data/index/write.lock (Read-only file system) at java.base/java.io.RandomAccessFile.open0(Native Method) at java.base/java.io.RandomAccessFile.open(RandomAccessFile.java:345) at java.base/java.io.RandomAccessFile.<init>(RandomAccessFile.java:259) at java.base/java.io.RandomAccessFile.<init>(RandomAccessFile.java:214) at org.apache.lucene.store.NativeFSLock.obtain(NativeFSLockFactory.java:203) at org.apache.lucene.store.Lock.obtain(Lock.java:95) ... 33 more 17-Jan-2019 23:27:24.206 WARNING [http-nio-8080-exec-8] org.apache.solr.handler.XMLLoader.processUpdate unexpected attribute commit/@softCommit 17-Jan-2019 23:27:24.206 INFO [http-nio-8080-exec-8] org.apache.solr.update.DirectUpdateHandler2.commit start commit(optimize=false,waitFlush=false,waitSearcher=true,expungeDeletes=false) 17-Jan-2019 23:27:24.207 INFO [http-nio-8080-exec-8] org.apache.solr.search.SolrIndexSearcher.<init> Opening Searcher@781d94fc main 17-Jan-2019 23:27:24.209 INFO [pool-1-thread-1] org.apache.solr.search.SolrIndexSearcher.warm autowarming Searcher@781d94fc main from Searcher@153b3170 main fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} 17-Jan-2019 23:27:24.209 INFO [pool-1-thread-1] org.apache.solr.search.SolrIndexSearcher.warm autowarming result for Searcher@781d94fc main fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} 17-Jan-2019 23:27:24.209 INFO [pool-1-thread-1] org.apache.solr.search.SolrIndexSearcher.warm autowarming Searcher@781d94fc main from Searcher@153b3170 main filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} 17-Jan-2019 23:27:24.209 INFO [pool-1-thread-1] org.apache.solr.search.SolrIndexSearcher.warm autowarming result for Searcher@781d94fc main filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} 17-Jan-2019 23:27:24.209 INFO [pool-1-thread-1] org.apache.solr.search.SolrIndexSearcher.warm autowarming Searcher@781d94fc main from Searcher@153b3170 main queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} 17-Jan-2019 23:27:24.209 INFO [pool-1-thread-1] org.apache.solr.search.SolrIndexSearcher.warm autowarming result for Searcher@781d94fc main queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} 17-Jan-2019 23:27:24.209 INFO [pool-1-thread-1] org.apache.solr.search.SolrIndexSearcher.warm autowarming Searcher@781d94fc main from Searcher@153b3170 main documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} 17-Jan-2019 23:27:24.209 INFO [pool-1-thread-1] org.apache.solr.search.SolrIndexSearcher.warm autowarming result for Searcher@781d94fc main documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} 17-Jan-2019 23:27:24.209 INFO [pool-1-thread-1] org.apache.solr.core.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@781d94fc main 17-Jan-2019 23:27:24.209 INFO [pool-1-thread-1] org.apache.solr.core.QuerySenderListener.newSearcher QuerySenderListener done. 17-Jan-2019 23:27:24.210 INFO [pool-1-thread-1] org.apache.solr.core.SolrCore.registerSearcher [] Registered new searcher Searcher@781d94fc main 17-Jan-2019 23:27:24.207 INFO [http-nio-8080-exec-8] org.apache.solr.update.DirectUpdateHandler2.commit end_commit_flush 17-Jan-2019 23:27:24.212 INFO [pool-1-thread-1] org.apache.solr.search.SolrIndexSearcher.close Closing Searcher@153b3170 main fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} 17-Jan-2019 23:27:24.212 INFO [http-nio-8080-exec-8] org.apache.solr.update.processor.LogUpdateProcessor.finish {commit=} 0 6 17-Jan-2019 23:27:24.212 INFO [http-nio-8080-exec-8] org.apache.solr.core.SolrCore.execute [] webapp=/solr path=/update params={} status=0 QTime=6 -- System Information: Debian Release: buster/sid APT prefers unstable APT policy: (500, 'unstable'), (500, 'testing'), (500, 'stable'), (500, 'oldstable'), (1, 'experimental') Architecture: amd64 (x86_64) Foreign Architectures: i386 Kernel: Linux 4.19.0-1-amd64 (SMP w/4 CPU cores) Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8), LANGUAGE=en_US.UTF-8 (charmap=UTF-8) Shell: /bin/sh linked to /bin/dash Init: systemd (via /run/systemd/system) LSM: AppArmor: enabled Versions of packages solr-tomcat depends on: ii solr-common 3.6.2+dfsg-16 ii tomcat9 9.0.14-1 solr-tomcat recommends no packages. solr-tomcat suggests no packages. -- no debconf information __ This is the maintainer address of Debian's Java team <https://alioth-lists.debian.net/cgi-bin/mailman/listinfo/pkg-java-maintainers>. Please use debian-j...@lists.debian.org for discussions and questions.