[
https://issues.apache.org/jira/browse/SLING-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13919551#comment-13919551
]
Stefan Egli commented on SLING-3432:
------------------------------------
Two more points relevant here:
* this happened right after a topology change event where the leader changed
from instance 2 to instance 1
* hence the job manager might have had to reassign jobs while instance 2 was
reading it?
* I'm also seeing an oak repository traversal with the query that lists all
jobs:
{code}
04.03.2014 06:55:39.343 *WARN* [Apache Sling Job Background Loader]
org.apache.jackrabbit.oak.plugins.index.property.strategy.ContentMirrorStoreStrategy
Traversed 1000 nodes using index jcr:primaryType with filter
Filter(query=select [jcr:path], [jcr:score], * from [slingevent:Job] as a where
[event.job.application] = 'e4337f8f-47d2-41df-b3ab-0d40b1b2acd4' and
[slingevent:created] < cast('2014-03-04T06:55:09.143-05:00' as date) order by
[slingevent:created] /* xpath:
//element(*,slingevent:Job)[@event.job.application =
'e4337f8f-47d2-41df-b3ab-0d40b1b2acd4' and @slingevent:created <
xs:dateTime('2014-03-04T06:55:09.143-05:00')] order by @slingevent:created
ascending */, path=*,
property=[event.job.application=e4337f8f-47d2-41df-b3ab-0d40b1b2acd4,
slingevent:created=..2014-03-04T06:55:09.143-05:00)])
{code}
so maybe while the traversal was ongoing, the other instance deleted/moved
the job node?
> job deserialization issue in a cluster when reading while/before job is fully
> written
> -------------------------------------------------------------------------------------
>
> Key: SLING-3432
> URL: https://issues.apache.org/jira/browse/SLING-3432
> Project: Sling
> Issue Type: Bug
> Components: Extensions
> Affects Versions: Event 3.3.4
> Reporter: Stefan Egli
>
> There is a race condition between two instances in a cluster (eg oak or crx):
> Instance 1 is writing a job with a binary property, instance 2 is reading the
> job (likely triggered by discovery sending it a topologychangedevent). It
> looks like instance 2 is reading the job just about while instance 1 is still
> in the process or completely writing the job, or at least the binary.
> Resulting in the following exception:
> 04.03.2014 06:55:39.667 *WARN* [Apache Sling Job Background Loader]
> org.apache.sling.event.impl.jobs.JobManagerImpl Unable to read job from
> /var/eventing/jobs/assigned/e4337f8f-47d2-41df-b3ab-0d40b1b2acd4/slingevent:eventadmin/2014/3/3/8/45/cq.wcm.msm.job.pageEvent_9718d7db-85b4-4930-a2ba-11a80d772970_172
> java.lang.Exception: Unable to deserialize property 'pageEvent'
> at
> org.apache.sling.event.impl.support.ResourceHelper.cloneValueMap(ResourceHelper.java:213)
> at
> org.apache.sling.event.impl.jobs.JobManagerImpl.readJob(JobManagerImpl.java:538)
> at
> org.apache.sling.event.impl.jobs.BackgroundLoader.loadJobInTheBackground(BackgroundLoader.java:318)
> at
> org.apache.sling.event.impl.jobs.BackgroundLoader.loadJobsInTheBackground(BackgroundLoader.java:294)
> at
> org.apache.sling.event.impl.jobs.BackgroundLoader.run(BackgroundLoader.java:203)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.io.EOFException: null
> at
> java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2280)
> at
> java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2749)
> at
> java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:779)
> at java.io.ObjectInputStream.<init>(ObjectInputStream.java:279)
> at
> org.apache.sling.event.impl.support.ResourceHelper.cloneValueMap(ResourceHelper.java:208)
> ... 5 common frames omitted
--
This message was sent by Atlassian JIRA
(v6.2#6252)
