[
https://issues.apache.org/jira/browse/CONNECTORS-590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748547#comment-13748547
]
Karl Wright commented on CONNECTORS-590:
----------------------------------------
Caught it in the act.
Here's the diagnostic output:
{code}
2013-08-23 09:06:59,838 [Worker thread '1'] DEBUG
org.apache.manifoldcf.diagnostics- ==== Forensics for record 1377263081763,
current status: 2 ====
2013-08-23 09:06:59,838 [Worker thread '1'] DEBUG
org.apache.manifoldcf.diagnostics- === Current stack trace ===
java.lang.Exception: Forensics stack trace
at
org.apache.manifoldcf.crawler.jobs.TrackerClass.printForensics(TrackerClass.java:216)
at
org.apache.manifoldcf.crawler.jobs.JobQueue.updateCompletedRecord(JobQueue.java:803)
at
org.apache.manifoldcf.crawler.jobs.JobManager.markDocumentCompletedMultiple(JobManager.java:2468)
at
org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:775)
2013-08-23 09:06:59,838 [Worker thread '1'] DEBUG
org.apache.manifoldcf.diagnostics- === Active transactions ===
2013-08-23 09:06:59,838 [Worker thread '1'] DEBUG
org.apache.manifoldcf.diagnostics- === Pertinent History ===
2013-08-23 09:06:59,838 [Worker thread '1'] DEBUG
org.apache.manifoldcf.diagnostics- == About to commit transaction by 'Stuffer
thread' at 1377263199330 ==
java.lang.Exception: Precommit stack trace
at
org.apache.manifoldcf.crawler.jobs.TrackerClass.notePrecommit(TrackerClass.java:108)
at
org.apache.manifoldcf.crawler.jobs.JobManager.fetchAndProcessDocuments(JobManager.java:2352)
at
org.apache.manifoldcf.crawler.jobs.JobManager.getNextDocuments(JobManager.java:2099)
at
org.apache.manifoldcf.crawler.system.StufferThread.run(StufferThread.java:157)
2013-08-23 09:06:59,838 [Worker thread '1'] DEBUG
org.apache.manifoldcf.diagnostics- Transaction includes:
2013-08-23 09:06:59,838 [Worker thread '1'] DEBUG
org.apache.manifoldcf.diagnostics- Record 1377263081765 status modified
to 1: Make active
2013-08-23 09:06:59,838 [Worker thread '1'] DEBUG
org.apache.manifoldcf.diagnostics- Record 1377263081764 status modified
to 1: Make active
2013-08-23 09:06:59,838 [Worker thread '1'] DEBUG
org.apache.manifoldcf.diagnostics- Record 1377263081763 status modified
to 1: Make active
2013-08-23 09:06:59,838 [Worker thread '1'] DEBUG
org.apache.manifoldcf.diagnostics- == Commit transaction by 'Stuffer thread' at
1377263199331 ==
java.lang.Exception: Commit stack trace
at
org.apache.manifoldcf.crawler.jobs.TrackerClass.noteCommit(TrackerClass.java:172)
at
org.apache.manifoldcf.crawler.jobs.JobManager.fetchAndProcessDocuments(JobManager.java:2354)
at
org.apache.manifoldcf.crawler.jobs.JobManager.getNextDocuments(JobManager.java:2099)
at
org.apache.manifoldcf.crawler.system.StufferThread.run(StufferThread.java:157)
2013-08-23 09:06:59,838 [Worker thread '1'] DEBUG
org.apache.manifoldcf.diagnostics- Transaction includes:
2013-08-23 09:06:59,838 [Worker thread '1'] DEBUG
org.apache.manifoldcf.diagnostics- Record 1377263081765 status modified
to 1: Make active
2013-08-23 09:06:59,838 [Worker thread '1'] DEBUG
org.apache.manifoldcf.diagnostics- Record 1377263081764 status modified
to 1: Make active
2013-08-23 09:06:59,838 [Worker thread '1'] DEBUG
org.apache.manifoldcf.diagnostics- Record 1377263081763 status modified
to 1: Make active
2013-08-23 09:06:59,838 [Worker thread '1'] DEBUG
org.apache.manifoldcf.diagnostics- == About to read status by 'Worker thread
'1'' at 1377263219837 ==
java.lang.Exception: Pre-read stack trace
at
org.apache.manifoldcf.crawler.jobs.TrackerClass.notePreread(TrackerClass.java:144)
at
org.apache.manifoldcf.crawler.jobs.JobManager.markDocumentCompletedMultiple(JobManager.java:2458)
at
org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:775)
2013-08-23 09:06:59,839 [Worker thread '1'] DEBUG
org.apache.manifoldcf.diagnostics- == Read status by 'Worker thread '1'' at
1377263219838 ==
java.lang.Exception: Read stack trace
at
org.apache.manifoldcf.crawler.jobs.TrackerClass.noteRead(TrackerClass.java:126)
at
org.apache.manifoldcf.crawler.jobs.JobManager.markDocumentCompletedMultiple(JobManager.java:2461)
at
org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:775)
{code}
This shows clearly the following:
(1) Nothing remotely concurrent is going on with respect to the record in
question.
(2) The status value of "1" is written and committed to the database.
(3) Nothing else happened to the record for a while.
(4) The value of "2" was read from the database.
> ManifoldCF throws an unexpected state exception, very rarely
> ------------------------------------------------------------
>
> Key: CONNECTORS-590
> URL: https://issues.apache.org/jira/browse/CONNECTORS-590
> Project: ManifoldCF
> Issue Type: Bug
> Components: Framework core
> Affects Versions: ManifoldCF 1.0.1, ManifoldCF 1.1
> Environment: MySQL 5.5.28, for Linux (x86_64), ManifoldCF 1.1-dev
> PostgreSQL 9(?)
> Reporter: Karl Wright
> Assignee: Karl Wright
> Fix For: ManifoldCF 1.4
>
>
> The following exception occurred under this setup:
> {code}
> 2012/12/21 10:09:37 ERROR (Worker thread '78') - Exception tossed: Unexpected
> jobqueue status - record id 1356045273314, expecting active status, saw 0
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected
> jobqueue status - record id 1356045273314, expecting active status, saw 0
> at
> org.apache.manifoldcf.crawler.jobs.JobQueue.updateCompletedRecord(JobQueue.java:742)
> at
> org.apache.manifoldcf.crawler.jobs.JobManager.markDocumentCompletedMultiple(JobManager.java:2438)
> at
> org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:765)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
