Hi Kamil, Which example are you using? is this with the combined war, or is it one of the multiprocess examples, or is it the single-process quick start?
I really don't have any idea why a class that IS found in a particular jar cannot in turn find another class in the same jar, so I'll need as many details as possible. Karl On Tue, Dec 16, 2014 at 6:54 AM, Kamil Żyta <[email protected]> wrote: > > > find . -iname 'commons-compress*' > ./lib/commons-compress-1.8.1.jar > ./dist/lib/commons-compress-1.8.1.jar > ./framework/dist/lib/commons-compress-1.8.1.jar > > ./framework/build/webapp/crawler-ui-proprietary/WEB-INF/lib/commons-compress-1.8.1.jar > > ./framework/build/webapp/combined-service-proprietary/WEB-INF/lib/commons-compress-1.8.1.jar > > ./framework/build/webapp/authority-service/WEB-INF/lib/commons-compress-1.8.1.jar > ./framework/build/webapp/crawler-ui/WEB-INF/lib/commons-compress-1.8.1.jar > ./framework/build/webapp/api-service/WEB-INF/lib/commons-compress-1.8.1.jar > > ./framework/build/webapp/combined-service/WEB-INF/lib/commons-compress-1.8.1.jar > > ./framework/build/webapp/authority-service-proprietary/WEB-INF/lib/commons-compress-1.8.1.jar > > ./framework/build/webapp/api-service-proprietary/WEB-INF/lib/commons-compress-1.8.1.jar > > I follow > https://manifoldcf.apache.org/release/trunk/en_US/how-to-build-and-deploy.html#Building+the+framework+and+the+connectors+using+Apache+Ant > There aren't anything about clean-core-deps. I checkout fresh > release-1.8-branch. > > K > > On Tue, Dec 16, 2014 at 06:38:18AM -0500, Karl Wright wrote: > > Hi Kamil, > > > > I've confirmed that this should not be a classloader issue. The class in > > question is in commons-compress.jar at the root level (under dist/lib). > > The only way this would not be loadable is if you had TWO > commons-compress > > jars in your lib area. This is possible if you upgraded to mcf 1.8 and > did > > not do a make clean-core-deps before you did a make-core-deps, because > now > > all jars have versions attached to their names. > > > > Please confirm you do not have duplicate jars in this directory. > > > > Thanks, > > Karl > > > > > > On Tue, Dec 16, 2014 at 6:31 AM, Karl Wright <[email protected]> wrote: > > > > > > Hi Kamil, > > > > > > Your problem looks like a potential classloader issue. Let me do some > > > research and get back to you. > > > > > > Karl > > > > > > > > > > > > > > > > > > On Tue, Dec 16, 2014 at 5:34 AM, Kamil Żyta <[email protected]> > wrote: > > >> > > >> thx Karl but now I have new issue: > > >> > > >> FATAL 2014-12-16 11:12:58,496 (Worker thread '47') - Error tossed: > Could > > >> not initialize class > org.apache.commons.compress.archivers.sevenz.Coders > > >> java.lang.NoClassDefFoundError: Could not initialize class > > >> org.apache.commons.compress.archivers.sevenz.Coders > > >> at > > >> > org.apache.commons.compress.archivers.sevenz.SevenZFile.readEncodedHeader(SevenZFile.java:279) > > >> at > > >> > org.apache.commons.compress.archivers.sevenz.SevenZFile.readHeaders(SevenZFile.java:191) > > >> at > > >> > org.apache.commons.compress.archivers.sevenz.SevenZFile.<init>(SevenZFile.java:95) > > >> at > > >> > org.apache.commons.compress.archivers.sevenz.SevenZFile.<init>(SevenZFile.java:117) > > >> at > > >> org.apache.tika.parser.pkg.PackageParser.parse(PackageParser.java:130) > > >> at > > >> org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:244) > > >> at > > >> org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:244) > > >> at > > >> > org.apache.tika.parser.AutoDetectParser.parse(AutoDetectParser.java:121) > > >> at > > >> > org.apache.manifoldcf.agents.transformation.tika.TikaExtractor.addOrReplaceDocumentWithException(TikaExtractor.java:230) > > >> at > > >> > org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$PipelineAddEntryPoint.addOrReplaceDocumentWithException(IncrementalIngester.java:3257) > > >> at > > >> > org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$PipelineAddFanout.sendDocument(IncrementalIngester.java:3108) > > >> at > > >> > org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$PipelineObjectWithVersions.addOrReplaceDocumentWithException(IncrementalIngester.java:2739) > > >> at > > >> > org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.documentIngest(IncrementalIngester.java:792) > > >> at > > >> > org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.ingestDocumentWithException(WorkerThread.java:1610) > > >> at > > >> > org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.ingestDocumentWithException(WorkerThread.java:1558) > > >> at > > >> > org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector.processDocuments(SharedDriveConnector.java:911) > > >> at > > >> > org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:383) > > >> > > >> And another question: I use Solr 4.10 with Tika 1.5. MCF 1.8 have tika > > >> 1.6. How this affect document parsing? > > >> > > >> K > > >> > > >> On Mon, Dec 15, 2014 at 08:45:31AM -0500, Karl Wright wrote: > > >> > If you changed this file, you would need to rerun initialize.sh in > > >> order to > > >> > register the connector. > > >> > > > >> > Karl > > >> > > > >> > > > >> > On Mon, Dec 15, 2014 at 8:42 AM, Kamil Żyta <[email protected]> > > >> wrote: > > >> > > > > >> > > the same as connectors.xml: > > >> > > (...) > > >> > > <repositoryconnector name="Windows shares" > > >> > > > > >> > class="org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector"/> > > >> > > (...) > > >> > > > > >> > > K > > >> > > > > >> > > On Mon, Dec 15, 2014 at 08:39:07AM -0500, Karl Wright wrote: > > >> > > > Hi Kamil, > > >> > > > > > >> > > > What does connectors-proprietary.xml say about the jcifs > connector? > > >> > > > > > >> > > > Karl > > >> > > > > > >> > > > > > >> > > > On Mon, Dec 15, 2014 at 8:35 AM, Kamil Żyta < > [email protected]> > > >> > > wrote: > > >> > > > > > > >> > > > > Right, thx. Another problem: > > >> > > > > > > > >> > > > > > > >> > > > > >> > org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector(uninstalled) > > >> > > > > > > >> > > > > properties.xml: > > >> > > > > <libdir path="../connector-lib-proprietary"/> > > >> > > > > > > >> > > > > > cat ../connectors.xml > > >> > > > > <repositoryconnector name="Windows shares" > > >> > > > > > > >> > > > > >> > class="org.apache.manifoldcf.crawler.connectors.sharedrive.SharedDriveConnector"/> > > >> > > > > > > >> > > > > > ls ../connector-lib-proprietary > > >> > > > > jcifs.jar > > >> > > > > > > >> > > > > I think I checked/restarted everything. > > >> > > > > > > >> > > > > K > > >> > > > > > > >> > > > > On Mon, Dec 15, 2014 at 08:00:12AM -0500, Karl Wright wrote: > > >> > > > > > You have to run ./initialize.sh on the MCF 1.8 codebase for > the > > >> > > upgrade > > >> > > > > to > > >> > > > > > take place. > > >> > > > > > > > >> > > > > > Karl > > >> > > > > > > > >> > > > > > > > >> > > > > > On Mon, Dec 15, 2014 at 7:43 AM, Kamil Żyta < > > >> [email protected]> > > >> > > > > wrote: > > >> > > > > > > > > >> > > > > > > With release-1.8-branch is the same problem. > > >> > > > > > > > > >> > > > > > > K > > >> > > > > > > > > >> > > > > > > On Mon, Dec 15, 2014 at 06:47:12AM -0500, Karl Wright > wrote: > > >> > > > > > > > Hi Kamil, > > >> > > > > > > > > > >> > > > > > > > You cannot upgrade to trunk from 1.x. > > >> > > > > > > > > > >> > > > > > > > Try upgrading to branches/release-1.8-branch. > > >> > > > > > > > > > >> > > > > > > > Karl > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > On Mon, Dec 15, 2014 at 3:39 AM, Kamil Żyta < > > >> > > [email protected]> > > >> > > > > > > wrote: > > >> > > > > > > > > > > >> > > > > > > > > Hi, > > >> > > > > > > > > after upgrading to trunk I get 'Database exception: > > >> > > SQLException > > >> > > > > doing > > >> > > > > > > > > query (42703): ERROR: column "needpriority" does not > > >> exist'. > > >> > > > > > > > > How can I upgrade db schema? I tried ./initialize.sh > > >> without > > >> > > > > success. > > >> > > > > > > > > > > >> > > > > > > > > K > > >> > > > > > > > > > > >> > > > > > > > > On Fri, Dec 12, 2014 at 10:40:39AM -0500, Karl Wright > > >> wrote: > > >> > > > > > > > > > Ok, committed a fix. CONNECTORS-1121. > > >> > > > > > > > > > > > >> > > > > > > > > > Karl > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > On Fri, Dec 12, 2014 at 10:32 AM, Karl Wright < > > >> > > > > [email protected]> > > >> > > > > > > > > wrote: > > >> > > > > > > > > > > > > >> > > > > > > > > > > Ah, thanks, this is due to changes I made > yesterday. > > >> > > > > > > > > > > > > >> > > > > > > > > > > Hold on. > > >> > > > > > > > > > > Karl > > >> > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > On Fri, Dec 12, 2014 at 10:12 AM, Kamil Żyta < > > >> > > > > > > [email protected]> > > >> > > > > > > > > > > wrote: > > >> > > > > > > > > > >> > > >> > > > > > > > > > >> On Fri, Dec 12, 2014 at 09:55:41AM -0500, Karl > Wright > > >> > > wrote: > > >> > > > > > > > > > >> > I've created CONNECTORS-1120 for this fix. I > > >> should > > >> > > have > > >> > > > > > > something > > >> > > > > > > > > to > > >> > > > > > > > > > >> try > > >> > > > > > > > > > >> > shortly. > > >> > > > > > > > > > >> > > > >> > > > > > > > > > >> > > >> > > > > > > > > > >> I can't build mcf from source: > > >> > > > > > > > > > >> BUILD FAILED > > >> > > > > > > > > > >> /opt/mcf-trunk/build.xml:1438: Can't get > > >> > > > > > > > > > >> > > >> > > > > > > > > > > >> > > > > > > > > >> > > > > > > >> > > > > >> > https://www.apache.org/dist/manifoldcf/apache-manifoldcf-elasticsearch-plugin-2.0-bin.zip > > >> > > > > > > > > > >> to > > >> > > > > > > > > > >> > > >> > > > > > > > > > > >> > > > > > > > > >> > > > > > > >> > > > > >> > /opt/mcf-trunk/build/download/apache-manifoldcf-elasticsearch-plugin-bin.zip > > >> > > > > > > > > > >> > > >> > > > > > > > > > >> K > > >> > > > > > > > > > >> > > >> > > > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > >> > > > > > > >> > > > > >> > > > >
