On 31.8.15 4:06 , Robert Munteanu wrote:
On Mon, 2015-08-31 at 16:00 +0200, Michael Dürig wrote:
"The forked VM terminated without saying properly goodbye. VM crash
or
System.exit called ?" [2]. This happens quite often lately. See log
files with -X option [1]. Not much information though. Any ideas what
could be causing this?
To quote myself on a related thread
I've seen something similar in the Apache Sling builds, see
https://issues.apache.org/jira/browse/BUILDS-49
for details. It's not yet resolved but the most promising idea seems
to be that the Linux OOM killer steps in when builds allocate too much
memory and forcefully stops the process.
Not sure whether this is related. I don't see this "killed" entry in the
logs. In our case the forked JVM seems to just silently die.
Michael
Robert
Michael
[1]
https://builds.apache.org/job/Apache%20Jackrabbit%20Oak%20matrix/381/
jdk=jdk1.8.0_11,label=Ubuntu,nsfixtures=SEGMENT_MK,profile=integratio
nTesting/console
[2]
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-failsafe-plugin:2.12.4:integration
-test
(default) on project oak-core: Execution default of goal
org.apache.maven.plugins:maven-failsafe-plugin:2.12.4:integration
-test
failed: The forked VM terminated without saying properly goodbye. VM
crash or System.exit called ? -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
execute goal
org.apache.maven.plugins:maven-failsafe-plugin:2.12.4:integration
-test
(default) on project oak-core: Execution default of goal
org.apache.maven.plugins:maven-failsafe-plugin:2.12.4:integration
-test
failed: The forked VM terminated without saying properly goodbye. VM
crash or System.exit called ?
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor
.java:224)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor
.java:153)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor
.java:145)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProje
ct(LifecycleModuleBuilder.java:108)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProje
ct(LifecycleModuleBuilder.java:76)
at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThre
adedBuilder.build(SingleThreadedBuilder.java:51)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(Lifecycl
eStarter.java:116)
at
org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.
java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
sorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Laun
cher.java:289)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.jav
a:229)
at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(La
uncher.java:415)
at
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:
356)
Caused by: org.apache.maven.plugin.PluginExecutionException:
Execution
default of goal
org.apache.maven.plugins:maven-failsafe-plugin:2.12.4:integration
-test
failed: The forked VM terminated without saying properly goodbye. VM
crash or System.exit called ?
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(Default
BuildPluginManager.java:144)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor
.java:208)
... 19 more
Caused by: java.lang.RuntimeException: The forked VM terminated
without
saying properly goodbye. VM crash or System.exit called ?
at
org.apache.maven.plugin.surefire.booterclient.output.ForkClient.close
(ForkClient.java:257)
at
org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkSt
arter.java:301)
at
org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkSta
rter.java:116)
at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider
(AbstractSurefireMojo.java:740)
at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAllProvi
ders(AbstractSurefireMojo.java:682)
at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPre
conditionsChecked(AbstractSurefireMojo.java:648)
at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(Abstrac
tSurefireMojo.java:586)
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(Default
BuildPluginManager.java:133)
... 20 more
On 31.8.15 3:56 , Apache Jenkins Server wrote:
The Apache Jenkins build system has built Apache Jackrabbit Oak
matrix (build #381)
Status: Failure
Check console output at https://builds.apache.org/job/Apache%20Jack
rabbit%20Oak%20matrix/381/ to view the results.
Changes:
[reschke] OAK-3288: clarify DocumentStore contract with respect to
number formats by making the UpdateOp method signatures more
specific
Test results:
2 tests failed.
REGRESSION:
org.apache.jackrabbit.oak.jcr.AutoCreatedItemsTest.autoCreatedItem
s[0]
Error Message:
Failed to register node types.
Stack Trace:
javax.jcr.InvalidItemStateException: Failed to register node types.
at
org.apache.jackrabbit.oak.api.CommitFailedException.asRepositoryExc
eption(CommitFailedException.java:239)
at
org.apache.jackrabbit.oak.plugins.nodetype.write.ReadWriteNodeTypeM
anager.registerNodeTypes(ReadWriteNodeTypeManager.java:156)
at
org.apache.jackrabbit.commons.cnd.CndImporter.registerNodeTypes(Cnd
Importer.java:162)
at
org.apache.jackrabbit.commons.cnd.CndImporter.registerNodeTypes(Cnd
Importer.java:80)
at
org.apache.jackrabbit.oak.jcr.TestContentLoader.registerTestNodeTyp
es(TestContentLoader.java:79)
at
org.apache.jackrabbit.oak.jcr.TestContentLoader.loadTestContent(Tes
tContentLoader.java:54)
at
org.apache.jackrabbit.oak.jcr.AutoCreatedItemsTest.autoCreatedItems
(AutoCreatedItemsTest.java:42)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImp
l.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc
essorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(Framewo
rkMethod.java:45)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveC
allable.java:15)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(Framework
Method.java:42)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeM
ethod.java:20)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.
java:30)
at
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:263)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassR
unner.java:68)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassR
unner.java:47)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)
at
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60)
at
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229)
at
org.junit.runners.ParentRunner.access$000(ParentRunner.java:50)
at
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222)
at org.junit.runners.ParentRunner.run(ParentRunner.java:300)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:24)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:
511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecuto
r.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecut
or.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.jackrabbit.oak.api.CommitFailedException:
OakMerge0001: OakMerge0001: Failed to merge changes to the
underlying store (retries 5, 5089 ms)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
merge0(DocumentNodeStoreBranch.java:184)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
merge(DocumentNodeStoreBranch.java:123)
at
org.apache.jackrabbit.oak.plugins.document.DocumentRootBuilder.merg
e(DocumentRootBuilder.java:158)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStore.merge(
DocumentNodeStore.java:1526)
at
org.apache.jackrabbit.oak.core.MutableRoot.commit(MutableRoot.java:
247)
at
org.apache.jackrabbit.oak.core.MutableRoot.commit(MutableRoot.java:
258)
at
org.apache.jackrabbit.oak.plugins.nodetype.write.ReadWriteNodeTypeM
anager.registerNodeTypes(ReadWriteNodeTypeManager.java:145)
... 31 more
Caused by:
org.apache.jackrabbit.oak.plugins.document.DocumentStoreException:
update of 3:/jcr:system/jcr:nodeTypes/mix:language failed, race
condition?
at
org.apache.jackrabbit.oak.plugins.document.rdb.RDBDocumentStore.int
ernalCreateOrUpdate(RDBDocumentStore.java:830)
at
org.apache.jackrabbit.oak.plugins.document.rdb.RDBDocumentStore.cre
ateOrUpdate(RDBDocumentStore.java:272)
at
org.apache.jackrabbit.oak.plugins.document.util.LeaseCheckDocumentS
toreWrapper.createOrUpdate(LeaseCheckDocumentStoreWrapper.java:126)
at
org.apache.jackrabbit.oak.plugins.document.Commit.createOrUpdateNod
e(Commit.java:474)
at
org.apache.jackrabbit.oak.plugins.document.Commit.applyToDocumentSt
ore(Commit.java:368)
at
org.apache.jackrabbit.oak.plugins.document.Commit.prepare(Commit.ja
va:239)
at
org.apache.jackrabbit.oak.plugins.document.Commit.apply(Commit.java
:205)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
persist(DocumentNodeStoreBranch.java:273)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
persist(DocumentNodeStoreBranch.java:243)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
access$300(DocumentNodeStoreBranch.java:54)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch$
Persisted.persistTransientHead(DocumentNodeStoreBranch.java:594)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch$
Persisted.setRoot(DocumentNodeStoreBranch.java:542)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
setRoot(DocumentNodeStoreBranch.java:107)
at
org.apache.jackrabbit.oak.plugins.document.DocumentRootBuilder.purg
e(DocumentRootBuilder.java:173)
at
org.apache.jackrabbit.oak.plugins.document.DocumentRootBuilder.upda
ted(DocumentRootBuilder.java:99)
at
org.apache.jackrabbit.oak.plugins.memory.MemoryNodeBuilder.updated(
MemoryNodeBuilder.java:214)
at
org.apache.jackrabbit.oak.plugins.memory.MemoryNodeBuilder.setPrope
rty(MemoryNodeBuilder.java:508)
at
org.apache.jackrabbit.oak.plugins.document.AbstractDocumentNodeBuil
der.setChildNode(AbstractDocumentNodeBuilder.java:59)
at
org.apache.jackrabbit.oak.plugins.nodetype.TypeRegistration.validat
eAndCompilePropertyDefinition(TypeRegistration.java:420)
at
org.apache.jackrabbit.oak.plugins.nodetype.TypeRegistration.validat
eAndCompileType(TypeRegistration.java:342)
at
org.apache.jackrabbit.oak.plugins.nodetype.TypeRegistration.apply(T
ypeRegistration.java:140)
at
org.apache.jackrabbit.oak.plugins.nodetype.TypeEditorProvider.getRo
otEditor(TypeEditorProvider.java:80)
at
org.apache.jackrabbit.oak.spi.commit.CompositeEditorProvider.getRoo
tEditor(CompositeEditorProvider.java:80)
at
org.apache.jackrabbit.oak.spi.commit.EditorHook.processCommit(Edito
rHook.java:53)
at
org.apache.jackrabbit.oak.spi.commit.CompositeHook.processCommit(Co
mpositeHook.java:61)
at
org.apache.jackrabbit.oak.spi.commit.CompositeHook.processCommit(Co
mpositeHook.java:61)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch$
Persisted$1.call(DocumentNodeStoreBranch.java:570)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch$
Persisted$1.call(DocumentNodeStoreBranch.java:566)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
withCurrentBranch(DocumentNodeStoreBranch.java:289)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
access$600(DocumentNodeStoreBranch.java:54)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch$
Persisted.merge(DocumentNodeStoreBranch.java:566)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
merge0(DocumentNodeStoreBranch.java:167)
... 37 more
FAILED:
org.apache.jackrabbit.oak.jcr.nodetype.NodeTypeTest.trivialUpdates
[0]
Error Message:
Failed to register node types.
Stack Trace:
javax.jcr.InvalidItemStateException: Failed to register node types.
at
org.apache.jackrabbit.oak.api.CommitFailedException.asRepositoryExc
eption(CommitFailedException.java:239)
at
org.apache.jackrabbit.oak.plugins.nodetype.write.ReadWriteNodeTypeM
anager.registerNodeTypes(ReadWriteNodeTypeManager.java:156)
at
org.apache.jackrabbit.oak.jcr.nodetype.NodeTypeTest.trivialUpdates(
NodeTypeTest.java:188)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImp
l.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc
essorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(Framewo
rkMethod.java:45)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveC
allable.java:15)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(Framework
Method.java:42)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeM
ethod.java:20)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.
java:30)
at
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:263)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassR
unner.java:68)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassR
unner.java:47)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)
at
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60)
at
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229)
at
org.junit.runners.ParentRunner.access$000(ParentRunner.java:50)
at
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222)
at org.junit.runners.ParentRunner.run(ParentRunner.java:300)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:24)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:
511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecuto
r.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecut
or.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.jackrabbit.oak.api.CommitFailedException:
OakMerge0001: OakMerge0001: Failed to merge changes to the
underlying store (retries 5, 4650 ms)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
merge0(DocumentNodeStoreBranch.java:184)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
merge(DocumentNodeStoreBranch.java:123)
at
org.apache.jackrabbit.oak.plugins.document.DocumentRootBuilder.merg
e(DocumentRootBuilder.java:158)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStore.merge(
DocumentNodeStore.java:1526)
at
org.apache.jackrabbit.oak.core.MutableRoot.commit(MutableRoot.java:
247)
at
org.apache.jackrabbit.oak.core.MutableRoot.commit(MutableRoot.java:
258)
at
org.apache.jackrabbit.oak.plugins.nodetype.write.ReadWriteNodeTypeM
anager.registerNodeTypes(ReadWriteNodeTypeManager.java:145)
... 27 more
Caused by:
org.apache.jackrabbit.oak.plugins.document.DocumentStoreException:
update of
4:/jcr:system/jcr:nodeTypes/mix:versionable/rep:namedPropertyDefini
tions failed, race condition?
at
org.apache.jackrabbit.oak.plugins.document.rdb.RDBDocumentStore.int
ernalCreateOrUpdate(RDBDocumentStore.java:830)
at
org.apache.jackrabbit.oak.plugins.document.rdb.RDBDocumentStore.cre
ateOrUpdate(RDBDocumentStore.java:272)
at
org.apache.jackrabbit.oak.plugins.document.util.LeaseCheckDocumentS
toreWrapper.createOrUpdate(LeaseCheckDocumentStoreWrapper.java:126)
at
org.apache.jackrabbit.oak.plugins.document.Commit.createOrUpdateNod
e(Commit.java:474)
at
org.apache.jackrabbit.oak.plugins.document.Commit.applyToDocumentSt
ore(Commit.java:368)
at
org.apache.jackrabbit.oak.plugins.document.Commit.prepare(Commit.ja
va:239)
at
org.apache.jackrabbit.oak.plugins.document.Commit.apply(Commit.java
:205)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
persist(DocumentNodeStoreBranch.java:273)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
persist(DocumentNodeStoreBranch.java:243)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
access$300(DocumentNodeStoreBranch.java:54)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch$
Persisted.persistTransientHead(DocumentNodeStoreBranch.java:594)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch$
Persisted.setRoot(DocumentNodeStoreBranch.java:542)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
setRoot(DocumentNodeStoreBranch.java:107)
at
org.apache.jackrabbit.oak.plugins.document.DocumentRootBuilder.purg
e(DocumentRootBuilder.java:173)
at
org.apache.jackrabbit.oak.plugins.document.DocumentRootBuilder.upda
ted(DocumentRootBuilder.java:99)
at
org.apache.jackrabbit.oak.plugins.memory.MemoryNodeBuilder.updated(
MemoryNodeBuilder.java:214)
at
org.apache.jackrabbit.oak.plugins.memory.MemoryNodeBuilder.setPrope
rty(MemoryNodeBuilder.java:508)
at
org.apache.jackrabbit.oak.plugins.memory.MemoryNodeBuilder.setPrope
rty(MemoryNodeBuilder.java:522)
at
org.apache.jackrabbit.oak.plugins.nodetype.TypeRegistration.validat
eAndCompilePropertyDefinition(TypeRegistration.java:376)
at
org.apache.jackrabbit.oak.plugins.nodetype.TypeRegistration.validat
eAndCompileType(TypeRegistration.java:342)
at
org.apache.jackrabbit.oak.plugins.nodetype.TypeRegistration.apply(T
ypeRegistration.java:140)
at
org.apache.jackrabbit.oak.plugins.nodetype.TypeEditorProvider.getRo
otEditor(TypeEditorProvider.java:80)
at
org.apache.jackrabbit.oak.spi.commit.CompositeEditorProvider.getRoo
tEditor(CompositeEditorProvider.java:80)
at
org.apache.jackrabbit.oak.spi.commit.EditorHook.processCommit(Edito
rHook.java:53)
at
org.apache.jackrabbit.oak.spi.commit.CompositeHook.processCommit(Co
mpositeHook.java:61)
at
org.apache.jackrabbit.oak.spi.commit.CompositeHook.processCommit(Co
mpositeHook.java:61)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch$
Persisted$1.call(DocumentNodeStoreBranch.java:570)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch$
Persisted$1.call(DocumentNodeStoreBranch.java:566)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
withCurrentBranch(DocumentNodeStoreBranch.java:289)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
access$600(DocumentNodeStoreBranch.java:54)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch$
Persisted.merge(DocumentNodeStoreBranch.java:566)
at
org.apache.jackrabbit.oak.plugins.document.DocumentNodeStoreBranch.
merge0(DocumentNodeStoreBranch.java:167)
... 33 more
