On Mon, 2006-08-28 at 14:50 +0300, Jukka Zitting wrote:
> Hi,
>
> On 8/28/06, Christian Zanata <[EMAIL PROTECTED]> wrote:
> > [ERROR] 20060825 17:06:40
> > (org.apache.jackrabbit.core.observation.ObservationManagerFactory) -
> > Synchronous EventConsumer threw exception. java.lang.OutOfMemoryError
> >
> > This error seems happening when the repository tries to re-index the
> > workspace, but we don't have more stack traces.
> > [...]
> > could anybody heps us to understand what's happening?
>
> There are two likely causes for that; either Lucene is running out of
> memory while merging the index segments, or one of the index filters
> runs out of memory trying to parse one of the binary documents in the
> repository. Without a complete stack trace it is difficult to
> determine the exact cause of the problems.
>
Hi,
in our stack-trace there are other orrors, but I don't know if this
errors are related to this problem.
First one is that Lucene have some problems indexing some MsOffice
documents, but as i read on the internet it seems that the problem is
that sometimes the extension .doc isn't related to a real .doc file.
-------
[DEBUG] 20060803 08:24:01 (org.apache.jackrabbit.core.query.LazyReader)
- Dump:
java.io.IOException: Invalid header signature; read 8656037701166316554,
expected -2226271756974174256
at org.apache.jackrabbit.core.query.MsWordTextFilter
$1.initializeReader(MsWordTextFilter.java:78)
at
org.apache.jackrabbit.core.query.LazyReader.read(LazyReader.java:79)
at
org.apache.lucene.analysis.standard.FastCharStream.refill(FastCharStream.java:68)
at
org.apache.lucene.analysis.standard.FastCharStream.readChar(FastCharStream.java:44)
at
org.apache.lucene.analysis.standard.FastCharStream.BeginToken(FastCharStream.java:78)
at
org.apache.lucene.analysis.standard.StandardTokenizerTokenManager.getNextToken(StandardTokenizerTokenManager.java:1105)
at
org.apache.lucene.analysis.standard.StandardTokenizer.jj_ntk(StandardTokenizer.java:150)
at
org.apache.lucene.analysis.standard.StandardTokenizer.next(StandardTokenizer.java:28)
at
org.apache.lucene.analysis.standard.StandardFilter.next(StandardFilter.java:40)
at
org.apache.lucene.analysis.LowerCaseFilter.next(LowerCaseFilter.java:32)
at org.apache.lucene.analysis.StopFilter.next(StopFilter.java:98)
at
org.apache.lucene.index.DocumentWriter.invertDocument(DocumentWriter.java:143)
at
org.apache.lucene.index.DocumentWriter.addDocument(DocumentWriter.java:81)
at
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:307)
at
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:294)
at
org.apache.jackrabbit.core.query.lucene.AbstractIndex.addDocument(AbstractIndex.java:129)
at
org.apache.jackrabbit.core.query.lucene.VolatileIndex.commitPending(VolatileIndex.java:164)
at
org.apache.jackrabbit.core.query.lucene.VolatileIndex.addDocument(VolatileIndex.java:86)
at org.apache.jackrabbit.core.query.lucene.MultiIndex
$AddNode.execute(MultiIndex.java:1304)
at
org.apache.jackrabbit.core.query.lucene.MultiIndex.executeAndLog(MultiIndex.java:763)
at
org.apache.jackrabbit.core.query.lucene.MultiIndex.createIndex(MultiIndex.java:838)
at
org.apache.jackrabbit.core.query.lucene.MultiIndex.createIndex(MultiIndex.java:844)
at
org.apache.jackrabbit.core.query.lucene.MultiIndex.createIndex(MultiIndex.java:844)
at
org.apache.jackrabbit.core.query.lucene.MultiIndex.createIndex(MultiIndex.java:844)
at
org.apache.jackrabbit.core.query.lucene.MultiIndex.createIndex(MultiIndex.java:844)
at
org.apache.jackrabbit.core.query.lucene.MultiIndex.createIndex(MultiIndex.java:844)
at
org.apache.jackrabbit.core.query.lucene.MultiIndex.createIndex(MultiIndex.java:844)
at
org.apache.jackrabbit.core.query.lucene.MultiIndex.createIndex(MultiIndex.java:844)
at
org.apache.jackrabbit.core.query.lucene.MultiIndex.<init>(MultiIndex.java:271)
at
org.apache.jackrabbit.core.query.lucene.SearchIndex.doInit(SearchIndex.java:218)
at
org.apache.jackrabbit.core.query.AbstractQueryHandler.init(AbstractQueryHandler.java:43)
at
org.apache.jackrabbit.core.SearchManager.initializeQueryHandler(SearchManager.java:529)
at
org.apache.jackrabbit.core.SearchManager.<init>(SearchManager.java:273)
at
org.apache.jackrabbit.core.RepositoryImpl.getSystemSearchManager(RepositoryImpl.java:560)
at org.apache.jackrabbit.core.RepositoryImpl.access
$300(RepositoryImpl.java:84)
at org.apache.jackrabbit.core.RepositoryImpl
$WorkspaceInfo.getSearchManager(RepositoryImpl.java:1434)
at
org.apache.jackrabbit.core.RepositoryImpl.initWorkspace(RepositoryImpl.java:540)
at
org.apache.jackrabbit.core.RepositoryImpl.<init>(RepositoryImpl.java:245)
at
org.apache.jackrabbit.core.RepositoryImpl.create(RepositoryImpl.java:484)
at
org.apache.jackrabbit.core.jndi.BindableRepository.init(BindableRepository.java:136)
at
org.apache.jackrabbit.core.jndi.BindableRepository.create(BindableRepository.java:122)
at
org.apache.jackrabbit.core.jndi.BindableRepositoryFactory.createInstance(BindableRepositoryFactory.java:58)
at
org.apache.jackrabbit.core.jndi.RegistryHelper.registerRepository(RegistryHelper.java:59)
at
it.wavegroup.imco.services.RepositoryInitService.registerRepository(Unknown
Source)
at
it.wavegroup.imco.jackrabbit.RepositoryInit.startupRepository(Unknown
Source)
at it.wavegroup.imco.servlets.ApplicationInit.startupRepository(Unknown
Source)
at
it.wavegroup.imco.servlets.ApplicationInit.contextInitialized(Unknown
Source)
at
org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:3827)
at
org.apache.catalina.core.StandardContext.start(StandardContext.java:4343)
at
org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:823)
at
org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:807)
at
org.apache.catalina.core.StandardHost.addChild(StandardHost.java:595)
at
org.apache.catalina.core.StandardHostDeployer.addChild(StandardHostDeployer.java:903)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:324)
at
org.apache.commons.beanutils.MethodUtils.invokeMethod(MethodUtils.java:216)
at org.apache.commons.digester.SetNextRule.end(SetNextRule.java:256)
at org.apache.commons.digester.Rule.end(Rule.java:276)
at org.apache.commons.digester.Digester.endElement(Digester.java:1058)
at
org.apache.catalina.util.CatalinaDigester.endElement(CatalinaDigester.java:76)
at org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown
Source)
at
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanEndElement(Unknown
Source)
at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl
$FragmentContentDispatcher.dispatch(Unknown Source)
at
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown
Source)
at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source)
at org.apache.commons.digester.Digester.parse(Digester.java:1567)
at
org.apache.catalina.core.StandardHostDeployer.install(StandardHostDeployer.java:488)
at
org.apache.catalina.core.StandardHost.install(StandardHost.java:863)
at
org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:483)
at
org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:427)
at org.apache.catalina.startup.HostConfig.start(HostConfig.java:983)
at
org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:349)
at
org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:119)
at
org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1091)
at org.apache.catalina.core.StandardHost.start(StandardHost.java:789)
at
org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1083)
at
org.apache.catalina.core.StandardEngine.start(StandardEngine.java:478)
at
org.apache.catalina.core.StandardService.start(StandardService.java:480)
at
org.apache.catalina.core.StandardServer.start(StandardServer.java:2313)
at org.apache.catalina.startup.Catalina.start(Catalina.java:556)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:324)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:287)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:425)
[ WARN] 20060803 08:24:01 (org.apache.jackrabbit.core.query.LazyReader)
- exception initializing reader
org.apache.jackrabbit.core.query.MsWordTextFilter$1:
java.io.IOException: Invalid header signature; read 8656037701166316554,
expected -2226271756974174256
Then there are a lot of nullpointer exceptions
[DEBUG] 20060803 08:37:17 (org.apache.jackrabbit.core.ItemManager) -
removing item 8637bf5f-4689-4e75-888f-b7b89bef40c8 from cache
[ WARN] 20060803 08:40:13 (org.apache.jackrabbit.core.RepositoryImpl) -
Existing lock file at C:\Wave\Repository\.lock deteteced. Repository was
not shut down properly.
[ERROR] 20060803 09:33:14
(org.apache.jackrabbit.core.observation.ObservationManagerFactory) -
Synchronous EventConsumer threw exception.
java.lang.NullPointerException: null values not allowed
at
org.apache.commons.collections.map.AbstractReferenceMap.put(AbstractReferenceMap.java:251)
at
org.apache.jackrabbit.core.version.VersionManagerImpl.getItem(VersionManagerImpl.java:242)
at
org.apache.jackrabbit.core.version.AbstractVersionManager.getVersion(AbstractVersionManager.java:62)
at
org.apache.jackrabbit.core.version.VersionItemStateProvider.getItemState(VersionItemStateProvider.java:131)
at
org.apache.jackrabbit.core.state.SharedItemStateManager.getItemState(SharedItemStateManager.java:212)
at
org.apache.jackrabbit.core.state.LocalItemStateManager.getPropertyState(LocalItemStateManager.java:111)
at
org.apache.jackrabbit.core.state.LocalItemStateManager.getItemState(LocalItemStateManager.java:143)
at
org.apache.jackrabbit.core.state.SessionItemStateManager.getItemState(SessionItemStateManager.java:127)
at
org.apache.jackrabbit.core.query.lucene.NodeIndexer.createDoc(NodeIndexer.java:155)
at
org.apache.jackrabbit.core.query.lucene.NodeIndexer.createDocument(NodeIndexer.java:112)
at
org.apache.jackrabbit.core.query.lucene.SearchIndex.createDocument(SearchIndex.java:449)
at org.apache.jackrabbit.core.query.lucene.SearchIndex
$2.next(SearchIndex.java:292)
at
org.apache.jackrabbit.core.query.lucene.MultiIndex.update(MultiIndex.java:313)
at
org.apache.jackrabbit.core.query.lucene.SearchIndex.updateNodes(SearchIndex.java:279)
at
org.apache.jackrabbit.core.SearchManager.onEvent(SearchManager.java:476)
at
org.apache.jackrabbit.core.observation.EventConsumer.consumeEvents(EventConsumer.java:230)
at
org.apache.jackrabbit.core.observation.ObservationManagerFactory.dispatchEvents(ObservationManagerFactory.java:218)
at
org.apache.jackrabbit.core.observation.EventStateCollection.dispatch(EventStateCollection.java:430)
at
org.apache.jackrabbit.core.observation.DelegatingObservationDispatcher.dispatch(DelegatingObservationDispatcher.java:105)
at
org.apache.jackrabbit.core.observation.DelegatingObservationDispatcher.dispatchEvents(DelegatingObservationDispatcher.java:87)
at
org.apache.jackrabbit.core.observation.EventStateCollection.dispatch(EventStateCollection.java:430)
at org.apache.jackrabbit.core.state.SharedItemStateManager
$Update.end(SharedItemStateManager.java:607)
at
org.apache.jackrabbit.core.state.XAItemStateManager.commit(XAItemStateManager.java:170)
at
org.apache.jackrabbit.core.version.XAVersionManager.commit(XAVersionManager.java:440)
at
org.apache.jackrabbit.core.TransactionContext.commit(TransactionContext.java:172)
at
org.apache.jackrabbit.core.XASessionImpl.commit(XASessionImpl.java:324)
at
it.wavegroup.imco.jackrabbit.transaction.UserTransactionImpl.commit(Unknown
Source)
at
it.wavegroup.imco.services.SessionFacade.commitJackrabbitTransaction(Unknown
Source)
at it.wavegroup.imco.services.RepositoryService.removeNode(Unknown
Source)
at it.wavegroup.imco.actions.FilesAction.delete(Unknown Source)
at it.wavegroup.imco.actions.BaseAction.selectForward(Unknown Source)
at it.wavegroup.imco.actions.FilesAction.selectForward(Unknown Source)
at it.wavegroup.imco.actions.BaseAction.execute(Unknown Source)
at
org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:421)
at
org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:226)
at
org.apache.struts.action.ActionServlet.process(ActionServlet.java:1164)
at
org.apache.struts.action.ActionServlet.doGet(ActionServlet.java:397)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:237)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
at it.wavegroup.imco.servlets.AuthenticationFilter.doFilter(Unknown
Source)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:186)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:157)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:214)
at
org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
at
org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
at
org.apache.catalina.core.StandardContextValve.invokeInternal(StandardContextValve.java:198)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:152)
at
org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:540)
at
org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
at
org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:137)
at
org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:118)
at
org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:102)
at
org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at
org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveContext.java:104)
at
org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:520)
at
org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:929)
at
org.apache.coyote.tomcat5.CoyoteAdapter.service(CoyoteAdapter.java:160)
at
org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:300)
at org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:374)
at org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:743)
at
org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:675)
at org.apache.jk.common.SocketConnection.runIt(ChannelSocket.java:866)
at org.apache.tomcat.util.threads.ThreadPool
$ControlRunnable.run(ThreadPool.java:683)
at java.lang.Thread.run(Thread.java:534)
and last there are the outofMemory errors
[ERROR] 20060825 11:27:53
(org.apache.jackrabbit.core.observation.ObservationManagerFactory) -
Synchronous EventConsumer threw exception.
java.lang.OutOfMemoryError
...
[ERROR] 20060825 18:04:21
(org.apache.jackrabbit.core.observation.ObservationManagerFactory) -
Synchronous EventConsumer threw exception.
java.lang.OutOfMemoryError
[ WARN] 20060826 00:39:03 (org.apache.jackrabbit.core.RepositoryImpl) -
Existing lock file at C:\Wave\Repository\.lock deteteced. Repository was
not shut down properly.
All there errors happened a lot of times (a lot means 10, 20 times each
one), but I can't understand if all these causes the Out of Memory.
Maybe after the exception resources are never free, so after a while the
system exaust the memory, but also the number of errors is not so high
(in my opinion). I think there is something else (maybe something
similar with the sessions between jackrabbit 0.9 and 1.0).
> Jukka Zitting
chris
>