Hi Karl,
thanks for help.
In my case i've only one instance of MCF running, with both type of job (SP
and Generic), and so i have only one properties files (that i have
attached).
For information i used (multiprocess-file configuration) with postgres.
Do you have other suggestions? do you need more information, that i can
give you?
Thanks,
L.Alicata
2016-05-06 12:55 GMT+02:00 Karl Wright <[email protected]>:
> Hi Luca,
>
> Do you have multiple independent MCF clusters running at the same time?
> It sounds like you do: you have SP on one, and Generic on another. If so,
> you will need to be sure that the synchronization you are using (either
> zookeeper or file-based) does not overlap. Each cluster needs its own
> synchronization. If there is overlap, then doing things with one cluster
> may cause the other cluster to hang. This also means you have to have
> different properties files for the two clusters, of course.
>
> Thanks,
> Karl
>
>
>
>
> On Fri, May 6, 2016 at 4:32 AM, Luca Alicata <[email protected]>
> wrote:
>
>> Hi,
>> i'm using Manifold 2.2 with multi-process configuration in Jboss instance
>> inside a Windows Server 2012 and i've a set of job that work with
>> Sharepoint (SP) or Generic Connector (GC), that get file from a db.
>> With SP i've no problem, while with GC with a lot of document (one with
>> 47k and another with 60k), the Seed taking process, sometimes, not finish,
>> because the agents seem to stop (although java process is still alive).
>> After this, if i try to start any other job, that not start, like the
>> agents are stopped.
>>
>> Other times, this jobs work correctly and one time together work
>> correctly, running in the same moment.
>>
>> For information:
>>
>> - On Jboss there are only Manifold and Generic Repository application.
>>
>>
>> - On the same Virtual Server, there is another Jboss istance, with
>> solr istance and a web application.
>>
>>
>> - I've check if it was a type of memory problem, but it's not the
>> case.
>>
>>
>> - GC with almost 23k seed work always, at least in test that i've
>> done.
>>
>>
>> - In local instance of Jboss with Manifold and Generic Rpository
>> Application, i've not keep this problem.
>>
>> This is the only recurrent information that i've seen on manifold.log:
>> ---------------
>> Connection 0.0.0.0:62755<-><ip-address>:<port> shut down
>> Releasing connection
>> org.apache.http.impl.conn.ManagedClientConnectionImpl@6c98c1bd
>>
>> ---------------
>>
>> Thanks,
>> L. Alicata
>>
>
>
<?xml version="1.0" encoding="UTF-8" ?>
<!--
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to You under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
<configuration>
<!-- Point to the synchronization area -->
<property name="org.apache.manifoldcf.synchdirectory" value="./syncharea"/>
<!-- Select HSQLDB as the database implementation, and specify multiprocess access -->
<property name="org.apache.manifoldcf.databaseimplementationclass" value="org.apache.manifoldcf.core.database.DBInterfacePostgreSQL"/>
<property name="org.apache.manifoldcf.database.name" value="manifoldcf"/>
<property name="org.apache.manifoldcf.dbsuperusername" value="<user>"/>
<property name="org.apache.manifoldcf.dbsuperuserpassword" value="<pwd>"/>
<property name="org.apache.manifoldcf.database.maxhandles" value="100"/>
<property name="org.apache.manifoldcf.crawler.threads" value="50"/>
<!-- Point to a specific (common) logging file -->
<property name="org.apache.manifoldcf.logconfigfile" value="./logging.ini"/>
<!-- Specify the connectors to be loaded -->
<property name="org.apache.manifoldcf.connectorsconfigurationfile" value="../connectors.xml"/>
<!-- Pulizia DB -->
<property name="org.apache.manifoldcf.crawler.historycleanupinterval" value="172800000"/>
<!-- Tell MCF where to find the connector jars -->
<libdir path="../connector-lib"/>
<libdir path="../connector-common-lib"/>
<libdir path="../connector-lib-proprietary"/>
<!-- WSDD references -->
<!-- Any additional properties go here -->
</configuration>