Yes, infact: administrator@sengvivv01:/opt/manifoldcf/multiprocess-zk-example-proprietary$ more options.env.unix -Xms3048m -Xmx3048m -Dorg.apache.manifoldcf.configfile=./properties.xml -cp .:../lib/mcf-core.jar:../lib/mcf-agents.jar:../lib/mcf-pull-agent.jar:../lib/hsqldb-2.3.2.jar:../lib/postgresql-42.1.3.jar:../lib/commons-codec-1.10.jar:../lib/commons-collections-3.2.1.jar:../l ib/commons-collections4-4.1.jar:../lib/commons-discovery-0.5.jar:../lib/commons-el-1.0.jar:../lib/commons-exec-1.3.jar:../lib/commons-fileupload-1.3.3.jar:../lib/commons-io-2.5.jar:../lib/common s-lang-2.6.jar:../lib/commons-lang3-3.6.jar:../lib/commons-logging-1.2.jar:../lib/ecj-4.3.1.jar:../lib/gson-2.8.0.jar:../lib/guava-25.1-jre.jar:../lib/httpclient-4.5.6.jar:../lib/httpcore-4.4.10.jar:../lib/jasper-6.0.35.jar:../lib/jasper-el-6.0.35.jar:../lib/javax.servlet-api-3.1.0.jar:../lib/jna-4.3.0.jar:../lib/jna-platform-4.3.0.jar:../lib/json-simple-1.1.1.jar:../lib/jsp-api-2.1-glassfish-2.1.v20091210.jar:../lib/juli-6.0.35.jar:../lib/log4j-1.2-api-2.4.1.jar:../lib/log4j-api-2.4.1.jar:../lib/log4j-core-2.4.1.jar:../lib/mail-1.4.5.jar:../lib/serializer-2.7.1.jar:../lib/slf4j-api-1.7.25.jar:../lib/slf4j-simple-1.7.25.jar:../lib/velocity-1.7.jar:../lib/xalan-2.7.1.jar:../lib/xercesImpl-2.10.0.jar:../lib/xml-apis-1.4.01.jar:../lib/zookeeper-3.4.10.jar:../lib-proprietary/jtds-1.2.4.jar:../lib-proprietary/mariadb-java-client-1.1.7.jar:../lib-proprietary/mysql-connector-java-5.1.33.jar:
And: administrator@sengvivv01:/opt/manifoldcf/multiprocess-zk-example-proprietary$ sudo -u tomcat ./initialize.sh [sudo] password for administrator: Configuration file successfully read [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:host.name=sengvivv01.vimar.net [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.version=10.0.2 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-11-openjdk-amd64 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=.:../lib/mcf-core.jar:../lib/mcf-agents.jar:../lib/mcf-pull-agent.jar:../lib/hsqldb-2.3.2.jar:../lib/postgresql-42.1.3.jar:../lib/commons-codec-1.10.jar:../lib/commons-collections-3.2.1.jar:../lib/commons-collections4-4.1.jar:../lib/commons-discovery-0.5.jar:../lib/commons-el-1.0.jar:../lib/commons-exec-1.3.jar:../lib/commons-fileupload-1.3.3.jar:../lib/commons-io-2.5.jar:../lib/commons-lang-2.6.jar:../lib/commons-lang3-3.6.jar:../lib/commons-logging-1.2.jar:../lib/ecj-4.3.1.jar:../lib/gson-2.8.0.jar:../lib/guava-25.1-jre.jar:../lib/httpclient-4.5.6.jar:../lib/httpcore-4.4.10.jar:../lib/jasper-6.0.35.jar:../lib/jasper-el-6.0.35.jar:../lib/javax.servlet-api-3.1.0.jar:../lib/jna-4.3.0.jar:../lib/jna-platform-4.3.0.jar:../lib/json-simple-1.1.1.jar:../lib/jsp-api-2.1-glassfish-2.1.v20091210.jar:../lib/juli-6.0.35.jar:../lib/log4j-1.2-api-2.4.1.jar:../lib/log4j-api-2.4.1.jar:../lib/log4j-core-2.4.1.jar:../lib/mail-1.4.5.jar:../lib/serializer-2.7.1.jar:../lib/slf4j-api-1.7.25.jar:../lib/slf4j-simple-1.7.25.jar:../lib/velocity-1.7.jar:../lib/xalan-2.7.1.jar:../lib/xercesImpl-2.10.0.jar:../lib/xml-apis-1.4.01.jar:../lib/zookeeper-3.4.10.jar:../lib-proprietary/jtds-1.2.4.jar:../lib-proprietary/mariadb-java-client-1.1.7.jar:../lib-proprietary/mysql-connector-java-5.1.33.jar: [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA> [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.version=4.15.0-45-generic [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.name=tomcat [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.home=/opt/tomcat [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/opt/manifoldcf/multiprocess-zk-example-proprietary [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:8349 sessionTimeout=300000 watcher=org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection$ZooKeeperWatcher@14008db3 [main-SendThread(localhost6.localdomain6:8349)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost6.localdomain6/0:0:0:0:0:0:0:1:8349. Will not attempt to authenticate using SASL (unknown error) [main-SendThread(localhost6.localdomain6:8349)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost6.localdomain6/0:0:0:0:0:0:0:1:8349, initiating session [main-SendThread(localhost6.localdomain6:8349)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost6.localdomain6/0:0:0:0:0:0:0:1:8349, sessionid = 0x1690ba14da30059, negotiated timeout = 100000 WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.postgresql.jdbc.TimestampUtils (file:/opt/manifoldcf/lib/postgresql-42.1.3.jar) to field java.util.TimeZone.defaultTimeZone WARNING: Please consider reporting this to the maintainers of org.postgresql.jdbc.TimestampUtils WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:8349 sessionTimeout=300000 watcher=org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection$ZooKeeperWatcher@2f05be7f [main-SendThread(localhost6.localdomain6:8349)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost6.localdomain6/0:0:0:0:0:0:0:1:8349. Will not attempt to authenticate using SASL (unknown error) [main-SendThread(localhost6.localdomain6:8349)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost6.localdomain6/0:0:0:0:0:0:0:1:8349, initiating session [main-SendThread(localhost6.localdomain6:8349)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost6.localdomain6/0:0:0:0:0:0:0:1:8349, sessionid = 0x1690ba14da3005a, negotiated timeout = 100000 Successfully unregistered all domains Successfully unregistered all output connectors Successfully unregistered all transformation connectors Successfully unregistered all mapping connectors Successfully unregistered all authority connectors Successfully unregistered all repository connectors [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:8349 sessionTimeout=300000 watcher=org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection$ZooKeeperWatcher@163d04ff [main-SendThread(localhost.localdomain:8349)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost.localdomain/127.0.0.1:8349. Will not attempt to authenticate using SASL (unknown error) [main-SendThread(localhost.localdomain:8349)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost.localdomain/127.0.0.1:8349, initiating session [main-SendThread(localhost.localdomain:8349)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost.localdomain/127.0.0.1:8349, sessionid = 0x1690ba14da3005b, negotiated timeout = 100000 Successfully registered output connector 'org.apache.manifoldcf.agents.output.solr.SolrConnector' Successfully registered output connector 'org.apache.manifoldcf.agents.output.searchblox.SearchBloxConnector' Successfully registered output connector 'org.apache.manifoldcf.agents.output.opensearchserver.OpenSearchServerConnector' Successfully registered output connector 'org.apache.manifoldcf.agents.output.nullconnector.NullConnector' Successfully registered output connector 'org.apache.manifoldcf.agents.output.mongodboutput.MongodbOutputConnector' Successfully registered output connector 'org.apache.manifoldcf.agents.output.kafka.KafkaOutputConnector' Successfully registered output connector 'org.apache.manifoldcf.agents.output.hdfs.HDFSOutputConnector' Successfully registered output connector 'org.apache.manifoldcf.agents.output.gts.GTSConnector' Successfully registered output connector 'org.apache.manifoldcf.agents.output.filesystem.FileOutputConnector' Successfully registered output connector 'org.apache.manifoldcf.agents.output.elasticsearch.ElasticSearchConnector' Successfully registered output connector 'org.apache.manifoldcf.agents.output.cmisoutput.CmisOutputConnector' Successfully registered output connector 'org.apache.manifoldcf.agents.output.amazoncloudsearch.AmazonCloudSearchConnector' Successfully registered transformation connector 'org.apache.manifoldcf.agents.transformation.tikaservice.TikaExtractor' Successfully registered transformation connector 'org.apache.manifoldcf.agents.transformation.tika.TikaExtractor' Successfully registered transformation connector 'org.apache.manifoldcf.agents.transformation.opennlp.OpenNlpExtractor' Successfully registered transformation connector 'org.apache.manifoldcf.agents.transformation.nullconnector.NullConnector' Successfully registered transformation connector 'org.apache.manifoldcf.agents.transformation.htmlextractor.HtmlExtractor' Successfully registered transformation connector 'org.apache.manifoldcf.agents.transformation.forcedmetadata.ForcedMetadataConnector' Successfully registered transformation connector 'org.apache.manifoldcf.agents.transformation.documentfilter.DocumentFilter' Successfully registered transformation connector 'org.apache.manifoldcf.agents.transformation.contentlimiter.ContentLimiter' Successfully registered mapping connector 'org.apache.manifoldcf.authorities.mappers.regexp.RegexpMapper' Successfully registered authority connector 'org.apache.manifoldcf.authorities.authorities.sharepoint.SharePointAuthority' Successfully registered authority connector 'org.apache.manifoldcf.authorities.authorities.sharepoint.SharePointADAuthority' Successfully registered authority connector 'org.apache.manifoldcf.authorities.authorities.nuxeo.NuxeoAuthorityConnector' Successfully registered authority connector 'org.apache.manifoldcf.authorities.authorities.nullauthority.NullAuthority' Successfully registered authority connector 'org.apache.manifoldcf.authorities.authorities.meridio.MeridioAuthority' Successfully registered authority connector 'org.apache.manifoldcf.authorities.authorities.ldap.LDAPAuthority' Successfully registered authority connector 'org.apache.manifoldcf.authorities.authorities.jira.JiraAuthorityConnector' Successfully registered authority connector 'org.apache.manifoldcf.authorities.authorities.jdbc.JDBCAuthority' Successfully registered authority connector 'org.apache.manifoldcf.authorities.authorities.generic.GenericAuthority' Successfully registered authority connector 'org.apache.manifoldcf.authorities.authorities.DCTM.AuthorityConnector' Successfully registered authority connector 'org.apache.manifoldcf.authorities.authorities.confluence.ConfluenceAuthorityConnector' Successfully registered authority connector 'org.apache.manifoldcf.authorities.authorities.cmis.CmisAuthorityConnector' Successfully registered authority connector 'org.apache.manifoldcf.authorities.authorities.amazons3.AmazonS3Authority' Successfully registered authority connector 'org.apache.manifoldcf.authorities.authorities.alfrescowebscript.AlfrescoAuthorityConnector' Successfully registered authority connector 'org.apache.manifoldcf.authorities.authorities.activedirectory.ActiveDirectoryAuthority' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.wiki.WikiConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.webcrawler.WebcrawlerConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.sharepoint.SharePointRepository' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.rss.RSSConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.nuxeo.NuxeoRepositoryConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.meridio.MeridioConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.jira.JiraRepositoryConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.jdbc.JDBCConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.hdfs.HDFSRepositoryConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.gridfs.GridFSRepositoryConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.googledrive.GoogleDriveRepositoryConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.generic.GenericConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.filesystem.FileConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.filenet.FilenetConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.email.EmailConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.dropbox.DropboxRepositoryConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.DCTM.DCTM' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.confluence.ConfluenceRepositoryConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.cmis.CmisRepositoryConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.amazons3.AmazonS3Connector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.alfresco.AlfrescoRepositoryConnector' Successfully registered repository connector 'org.apache.manifoldcf.crawler.connectors.alfrescowebscript.AlfrescoConnector' Successfully registered notification connector 'org.apache.manifoldcf.crawler.notifications.slack.SlackConnector' Successfully registered notification connector 'org.apache.manifoldcf.crawler.notifications.rocketchat.RocketChatConnector' Successfully registered notification connector 'org.apache.manifoldcf.crawler.notifications.email.EmailConnector' Successfully initialized database and registered all connectors [Shutdown thread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x1690ba14da3005b closed [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x1690ba14da3005b [Shutdown thread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x1690ba14da3005a closed [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x1690ba14da3005a [Shutdown thread] INFO org.apache.zookeeper.ZooKeeper - Session: 0x1690ba14da30059 closed [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x1690ba14da30059 Furthermore, my MCF start from Tomcat Service and I configured /etc/systemd/system/tomcat.service : [Unit] Description=Apache Tomcat Web Application Container After=network.target [Service] Type=forking Environment=JAVA_HOME= /usr/lib/jvm/java-1.11.0-openjdk-amd64 Environment=CATALINA_PID=/opt/tomcat/temp/tomcat.pid Environment=CATALINA_HOME=/opt/tomcat Environment=CATALINA_BASE=/opt/tomcat Environment='CATALINA_OPTS=-Xms512M -Xmx1024M -server -XX:+UseParallelGC -Dorg.apache.manifoldcf.configfile=/opt/manifoldcf/multiprocess-zk-example-proprietary/properties.xml' Environment='JAVA_OPTS=-Djava.awt.headless=true -Djava.security.egd=file:/dev/./urandom' ExecStart=/opt/tomcat/bin/startup.sh ExecStop=/opt/tomcat/bin/shutdown.sh User=tomcat Group=tomcat UMask=0007 RestartSec=10 Restart=always [Install] WantedBy=multi-user.target And I added to properties.xml: <libdir path="../connector-common-lib"/> <libdir path="../connector-lib-proprietary"/> <!-- Inserisco per fargli vedere i jar dentro la cartella lib-proprietary --> <libdir path="../lib-proprietary"/> <!-- Any additional local properties go here --> </configuration> When I try to create a new “Repository connector”, I selected “JDBC”, after I choosed as database “ “MSSQL” I compiled server, username and password, I saved and I obtain the error: Threw exception: 'Driver class not found: net.sourceforge.jtds.jdbc.Driver' Da: Karl Wright <[email protected]> Inviato: mercoledì 20 febbraio 2019 17:06 A: [email protected] Oggetto: Re: Threw exception: 'Driver class not found: net.sourceforge.jtds.jdbc.Driver' You should be doing the following to run initialize.sh: cd dist/multiprocess-zk-example-proprietary ./initialize.sh The class path is pulled in from options.env.unix, which should include your jar: >>>>>> C:\wip\mcf\trunk\dist\multiprocess-zk-example-proprietary>more options.env.unix -Xms512m -Xmx512m -Dorg.apache.manifoldcf.configfile=./properties.xml -cp .:../lib/mcf-core.jar:../lib/mcf-agents.jar:../lib/mcf-pull-agent.jar:../lib/hsqldb-2.3.2.jar:../lib/postgresql-42.1.3.jar:../lib/commons-codec-1.10.jar:../lib/commons-collections-3.2.1.jar:../lib/commons-collections4-4.1.jar:../lib/commons-discovery-0.5.jar:../lib/commons-el-1.0.jar:../lib/commons-exec-1.3.jar:../lib/commons-fileupload-1.3.3.jar:../lib/commons-io-2.5.jar:../lib/commons-lang-2.6.jar:../lib/commons-lang3-3.6.jar:../lib/commons-logging-1.2.jar:../lib/ecj-4.3.1.jar:../lib/gson-2.8.0.jar:../lib/guava-25.1-jre.jar:../lib/httpclient-4.5.6.jar:../lib/httpcore-4.4.10.jar:../lib/jasper-6.0.35.jar:../lib/jasper-el-6.0.35.jar:../lib/javax.servlet-api-3.1.0.jar:../lib/jna-4.3.0.jar:../lib/jna-platform-4.3.0.jar:../lib/json-simple-1.1.1.jar:../lib/jsp-api-2.1-glassfish-2.1.v20091210.jar:../lib/juli-6.0.35.jar:../lib/log4j-1.2-api-2.4.1.jar:../lib/log4j-api-2.4.1.jar:../lib/log4j-core-2.4.1.jar:../lib/mail-1.4.5.jar:../lib/serializer-2.7.1.jar:../lib/slf4j-api-1.7.25.jar:../lib/slf4j-simple-1.7.25.jar:../lib/velocity-1.7.jar:../lib/xalan-2.7.1.jar:../lib/xercesImpl-2.10.0.jar:../lib/xml-apis-1.4.01.jar:../lib/zookeeper-3.4.10.jar:../lib-proprietary/jtds-1.2.4.jar:../lib-proprietary/mariadb-java-client-1.1.7.jar:../lib-proprietary/mysql-connector-java-5.1.33.jar: <<<<<< If it does not include your jar, it's because you did not rebuild after you placed the jar in the appropriate place. Karl On Wed, Feb 20, 2019 at 10:58 AM Karl Wright <[email protected]<mailto:[email protected]>> wrote: The question is: how are you *starting* the processes? and what process are you seeing the error from? You should *not* need to make any changes to the configuration if you put the jar file in place before building. Karl On Wed, Feb 20, 2019 at 9:47 AM Bisonti Mario <[email protected]<mailto:[email protected]>> wrote: Thanks, Karl but I didn’t download manually the .jar files. I compiled MCF 2.12 and I found the jar in the lib-proprietary folder. I added in properties.xml the : <libdir path="../lib-proprietary"/> I tried to : initialize.sh the db but I have the same error. Da: Karl Wright <[email protected]<mailto:[email protected]>> Inviato: mercoledì 20 febbraio 2019 15:15 A: [email protected]<mailto:[email protected]> Oggetto: Re: Threw exception: 'Driver class not found: net.sourceforge.jtds.jdbc.Driver' Hi Mario, You can't just plop down a jar in a directory and have this work, because ManifoldCF requires all JDBC drivers to be in the root classpath. They are therefore built into the classpath, which should happen if you use the startup scripts. Please review the "how-to-build-and-deploy" page. Karl On Wed, Feb 20, 2019 at 9:09 AM Bisonti Mario <[email protected]<mailto:[email protected]>> wrote: Hallo, I would like to use MSSQL as repository. I use /opt/manifoldcf/multiprocess-zk-example-proprietary/ so I added in properties.xml . . <libdir path="../lib-proprietary"/> . My MCF 2.12 was compiled by me. In the folder: /opt/manifoldcf/lib-proprietary I ave the files: jtds-1.2.4.jar mariadb-java-client-1.1.7.jar mysql-connector-java-5.1.33.jar jtds-1.2.4.jar My tomcat startup script points to: Environment='CATALINA_OPTS=-Xms512M -Xmx1024M -server -XX:+UseParallelGC -Dorg.apache.manifoldcf.configfile=/opt/manifoldcf/multiprocess-zk-example-proprietary/properties.xml' I restarted all, but when I try to use a MSSQL repository I obtain: Threw exception: 'Driver class not found: net.sourceforge.jtds.jdbc.Driver' What could I check? Thanks a lot Mario
