Hey Lewis, Thanks for the advice. You are correct that this class is in the guava lib. I rebuilt OODT core and then re-built the crawler and I now have a fresh guava-10.0.1.jar in my crawler lib and it is working.
Big thanks to you and Chris for helping me out. -Cam On Fri, Apr 25, 2014 at 6:06 PM, Lewis John Mcgibbney < [email protected]> wrote: > Hi Cameron I would suggest manually looking into the crawler pom.xml to see > if the google dependency (possibly guava) has been explicitly excluded. > Additionally you can try mvn dependency:tree to see if it may be being > excluded at another level. > What I suggest, if the above does not work, is to include the missing dep > in your crawler pom.xml, also log a jira issue and we can include it as > part of trunk. > Hth > Lewis > On Apr 25, 2014 4:47 PM, "Cameron Goodale" <[email protected]> wrote: > > > Hey Devs and Brian, > > > > I am trying to run a crawler action after a PGE has been run on a batch > > stub and I am getting a java.lang.NoClassDefFoundError: > > com/google/common/collect/Sets error, so I thought I'd ask the resident > > Googler for some help. > > > > I am not sure if this class needs to be included in the cas-crawler.jar > > file or if maven is supposed to fetch it from somewhere else. > > > > Any thoughts or ideas would be appreciated. Longer error message is > below. > > > > I am running: > > > > Workflow-0.7-SNAPSHOT > > Crawler-0.7-SNAPSHOT > > Resource-0.6 <--- this is by choice > > cli-0.7-SNAPSHOT > > pge-0.3-SNAPSHOT <-- This is by choice > > > > > > Thanks, > > > > Cameron > > > > INFO: Updating status to workflow as CRAWLING > > Apr 25, 2014 4:11:25 PM sun.net.www.protocol.http.HttpURLConnection > > writeRequests > > FINE: sun.net.www.MessageHeader@154e4e319 pairs: {POST / HTTP/1.1: > > null}{Content-Length: 232}{Content-Type: text/xml}{Cache-Control: > > no-cache}{Pragma: no-cache}{User-Agent: Java/1.6.0_21}{Host: > > localhost:9201}{Accept: text/html, image/gif, image/jpeg, *; q=.2, */*; > > q=.2}{Connection: keep-alive} > > Apr 25, 2014 4:11:25 PM sun.net.www.protocol.http.HttpURLConnection > > getInputStream > > FINE: sun.net.www.MessageHeader@47ef7de45 pairs: {null: HTTP/1.1 200 > > OK}{Server: Apache XML-RPC 1.0}{Connection: close}{Content-Type: > > text/xml}{Content-Length: 121} > > Apr 25, 2014 4:11:25 PM org.apache.oodt.cas.pge.PGETaskInstance > > runIngestCrawler > > INFO: Executing StdProductCrawler in productPath: > > [/snow-stor/output/MODSCAGv2NRT/1398467390502/h07v03] > > Apr 25, 2014 4:11:25 PM > > org.springframework.beans.factory.support.DefaultSingletonBeanRegistry > > getSingleton > > FINE: Creating shared instance of singleton bean 'DeleteDataFile' > > Apr 25, 2014 4:11:25 PM > > > > > org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory > > createBean > > FINE: Creating instance of bean 'DeleteDataFile' with merged definition > > [Root bean: class [org.apache.oodt.cas.crawl.action.DeleteFile]; > > scope=singleton; abstract=false; lazyInit=true; autowireCandidate=false; > > autowireMode=0; dependencyCheck=0; factoryBeanName=null; > > factoryMethodName=null; initMethodName=null; destroyMethodName=null; > > defined in URL [file:/usr/local/snow/crawler/policy/action-beans.xml]] > > Apr 25, 2014 4:11:25 PM > > > > > org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory > > createBean > > FINE: Eagerly caching bean 'DeleteDataFile' to allow for resolving > > potential circular references > > Exception in thread "Thread-14" java.lang.NoClassDefFoundError: > > com/google/common/collect/Sets > > at > > > > > org.apache.oodt.cas.crawl.action.CrawlerActionRepo.getActions(CrawlerActionRepo.java:49) > > at > > > > > org.apache.oodt.cas.crawl.ProductCrawler.validateActions(ProductCrawler.java:236) > > at > > > > > org.apache.oodt.cas.crawl.ProductCrawler.loadAndValidateActions(ProductCrawler.java:230) > > at org.apache.oodt.cas.crawl.ProductCrawler.crawl(ProductCrawler.java:83) > > at > > > > > org.apache.oodt.cas.pge.PGETaskInstance.runIngestCrawler(PGETaskInstance.java:405) > > at > > > > > org.apache.oodt.cas.pge.PGETaskInstance.ingestProducts(PGETaskInstance.java:349) > > at org.apache.oodt.cas.pge.PGETaskInstance.run(PGETaskInstance.java:454) > > at org.apache.oodt.cas.workflow.structs.TaskJob.execute(TaskJob.java:102) > > at > > > > > org.apache.oodt.cas.resource.system.extern.XmlRpcBatchStub$RunnableJob.run(XmlRpcBatchStub.java:229) > > at java.lang.Thread.run(Thread.java:619) > > > > -- > > > > Sent from a Tin Can attached to a String > > > -- Sent from a Tin Can attached to a String
