[
https://issues.apache.org/jira/browse/CONNECTORS-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16558819#comment-16558819
]
Steph van Schalkwyk edited comment on CONNECTORS-1191 at 7/26/18 7:52 PM:
--------------------------------------------------------------------------
I'm seeing this with 2.10 + ElasticSearch connector.
[root@clpaxd-iwh01 manifoldcf]# tail -f manifoldcf.log | grep -i 1532633627197
WARN 2018-07-26T14:45:57,202 (Worker thread '6') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:57,278 (Worker thread '4') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:57,281 (Worker thread '45') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:57,515 (Worker thread '5') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:57,680 (Worker thread '48') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:57,841 (Worker thread '6') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:57,864 (Worker thread '43') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:57,940 (Worker thread '49') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:58,355 (Worker thread '45') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:58,356 (Worker thread '5') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
With this console log:
14:45:57.940 [Worker thread '49'] WARN org.apache.manifoldcf.jobs - Service
interruption reported for job 1532633627197 connection 'FS': IO exception: null
14:45:58.355 [Worker thread '45'] WARN org.apache.manifoldcf.jobs - Service
interruption reported for job 1532633627197 connection 'FS': IO exception: null
14:45:58.356 [Worker thread '5'] WARN org.apache.manifoldcf.jobs - Service
interruption reported for job 1532633627197 connection 'FS': IO exception: null
agents process ran out of memory - shutting down
java.lang.OutOfMemoryError: Java heap space
at java.base/java.util.Arrays.copyOf(Arrays.java:3744)
at
java.base/java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:146)
at
java.base/java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:512)
at java.base/java.lang.StringBuilder.append(StringBuilder.java:141)
at
org.apache.manifoldcf.agents.output.elasticsearch.ElasticSearchIndex.jsonStringEscape(ElasticSearchIndex.java:368)
at
org.apache.manifoldcf.agents.output.elasticsearch.ElasticSearchIndex.writeField(ElasticSearchIndex.java:265)
at
org.apache.manifoldcf.agents.output.elasticsearch.ElasticSearchIndex$IndexRequestEntity.writeTo(ElasticSearchIndex.java:222)
at
org.apache.http.impl.execchain.RequestEntityProxy.writeTo(RequestEntityProxy.java:121)
at
org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:156)
at org.apache.http.impl.conn.CPoolProxy.sendRequestEntity(CPoolProxy.java:160)
at
org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:238)
at
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
at
org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at
org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at
org.apache.manifoldcf.agents.output.elasticsearch.ElasticSearchConnection$CallThread.run(ElasticSearchConnection.java:133)
[Thread-473] INFO org.eclipse.jetty.server.ServerConnector - Stopped
ServerConnector@5d235104\{HTTP/1.1}{0.0.0.0:8345}
[Thread-473] INFO org.eclipse.jetty.server.handler.ContextHandler - Stopped
o.e.j.w.WebAppContext@6105f8a3\{/mcf-api-service,file:/tmp/jetty-0.0.0.0-8345-mcf-api-service.war-_mcf-api-service-any-4726191205119752020.dir/webapp/,UNAVAILABLE}{/opt/manifoldcf/manifoldcf_single/././web/war/mcf-api-service.war}
[Thread-473] INFO org.eclipse.jetty.server.handler.ContextHandler - Stopped
o.e.j.w.WebAppContext@12365c88\{/mcf-authority-service,file:/tmp/jetty-0.0.0.0-8345-mcf-authority-service.war-_mcf-authority-service-any-14468185691543336630.dir/webapp/,UNAVAILABLE}{/opt/manifoldcf/manifoldcf_single/././web/war/mcf-authority-service.war}
was (Author: svanschalkwyk):
I'm seeing this with 2.10 + ElasticSearch connector.
[root@clpaxd-iwh01 manifoldcf]# tail -f manifoldcf.log | grep -i 1532633627197
WARN 2018-07-26T14:45:57,202 (Worker thread '6') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:57,278 (Worker thread '4') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:57,281 (Worker thread '45') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:57,515 (Worker thread '5') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:57,680 (Worker thread '48') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:57,841 (Worker thread '6') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:57,864 (Worker thread '43') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:57,940 (Worker thread '49') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:58,355 (Worker thread '45') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
WARN 2018-07-26T14:45:58,356 (Worker thread '5') - Service interruption
reported for job 1532633627197 connection 'FS': IO exception: null
> ManifoldCFException: Unexpected job status encountered
> ------------------------------------------------------
>
> Key: CONNECTORS-1191
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1191
> Project: ManifoldCF
> Issue Type: Bug
> Components: Web connector
> Affects Versions: ManifoldCF 2.0.2
> Environment: - Debian 7.8 x86_64 GNU/Linux
> - Java HotSpot(TM) 64-Bit Server VM (build 25.40-b25, mixed mode)
> - Server version: 5.5.41-0+wheezy1 (Debian)
> Reporter: Arcadius Ahouansou
> Assignee: Karl Wright
> Priority: Critical
> Fix For: ManifoldCF 1.9, ManifoldCF 2.1
>
> Attachments: 1433374857580-jobs.png, 1433374857580-schedule.png,
> CONNECTORS-1191-2.patch, CONNECTORS-1191.patch, manifoldcf2.0.2.log,
> stuffer-thread-manifoldcf.log, unexpected-jobqueue.png
>
>
> Hello.
> I am running the latest ManifoldCF 2.0.2 and my log is filled of
> {code}
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected job
> status encountered: 34
> at
> org.apache.manifoldcf.crawler.jobs.Jobs.returnJobToActive(Jobs.java:2073)
> at
> org.apache.manifoldcf.crawler.jobs.JobManager.resetJobs(JobManager.java:8261)
> at
> org.apache.manifoldcf.crawler.system.JobResetThread.run(JobResetThread.java:91)
> {code}
> I have attached full log for more detail.
> Note that I am running against MySQL.
> Thanks.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
