That’s the problem - the policy is wrong in the RADIX crawler policy. Can you open up a JIRA ticket to fix this? It’s probably wrong too in the default CAS-crawler policy. The value inside of that file should be [WORKFLOW_URL].
Please open up a JIRA and submit a patch. Thanks Angela! Cheers, Chris ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Chris Mattmann, Ph.D. Chief Architect Instrument Software and Science Data Systems Section (398) NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Office: 168-519, Mailstop: 168-527 Email: [email protected] WWW: http://sunset.usc.edu/~mattmann/ ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Adjunct Associate Professor, Computer Science Department University of Southern California, Los Angeles, CA 90089 USA ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ -----Original Message----- From: MengYing Wang <[email protected]> Date: Tuesday, November 4, 2014 at 11:35 AM To: Chris Mattmann <[email protected]> Cc: "[email protected]" <[email protected]>, Chris Mattmann <[email protected]> Subject: Re: RADiX CAS-Crawler cannot trigger workflow event >Dear Prof. Mattmann, > > >In the default property, there is a line "<prop >key="crawler.workflowmgr.url">[WORKFLOWMGR_URL]</prop>" while no >definition of the [WORKFLOW_URL]. > > > <!-- Default Properties --> > <property name="properties"> > <props> > <prop key="crawler.failure.dir">[FAILURE_DIR]</prop> > <prop key="crawler.backup.dir">[BACKUP_DIR]</prop> > <prop >key="crawler.workflowmgr.url">[WORKFLOWMGR_URL]</prop> > <prop key="crawler.filemgr.url">[FILEMGR_URL]</prop> > <prop >key="crawler.client.transferer">org.apache.oodt.cas.filemgr.datatransfer.L >ocalDataTransferFactory</prop> > <prop key="crawler.met.file.ext">met</prop> > <prop >key="crawler.pushpull.met.file.ext">[PUSHPULL_MET_FILE_EXT]</prop> > <prop key="crawler.anc.file.ext">anc</prop> > <prop key="crawler.anc.file.suffix"></prop> > <prop key="notification.mail.host"></prop> > <prop key="notification.sender"></prop> > <prop key="notification.success.subject"></prop> > <prop key="notification.success.message"></prop> > <prop key="notification.success.recipients"></prop> > </props> > </property> > > > >Below is the definition of the TriggerPostIngestWorkflow event with the >workflowMgrUrl. > > > <!-- Workflow Manager Actions --> > <bean id="TriggerPostIngestWorkflow" lazy-init="true" >class="org.apache.oodt.cas.crawl.action.WorkflowMgrStatusUpdate"> > <property name="description" value="Triggers workflow event with >the name [ProductType]Ingest" /> > <property name="ingestSuffix" value="Ingest" /> > <property name="workflowMgrUrl" >value="${crawler.workflowmgr.url}" /> > <property name="phases"> > <list> > <value type="java.lang.String">postIngestSuccess</value> > </list> > </property> > </bean> > > > >Thanks! > > >Best, >Mengying (Angela) Wang > > >On Tue, Nov 4, 2014 at 10:21 AM, Mattmann, Chris A (3980) ><[email protected]> wrote: > >Thanks Angela. What do you see in terms of your policy in >$OODT_HOME/crawler/policy in terms of action-beans.xml - do you >see a [WORKFLOW_URL] defined in there? > >++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >Chris Mattmann, Ph.D. >Chief Architect >Instrument Software and Science Data Systems Section (398) >NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA >Office: 168-519, Mailstop: 168-527 >Email: [email protected] >WWW: http://sunset.usc.edu/~mattmann/ >++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >Adjunct Associate Professor, Computer Science Department >University of Southern California, Los Angeles, CA 90089 USA >++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > > > > > >-----Original Message----- >From: MengYing Wang <[email protected]> >Date: Tuesday, November 4, 2014 at 11:07 AM >To: Chris Mattmann <[email protected]> >Cc: "[email protected]" <[email protected]>, Chris Mattmann ><[email protected]> >Subject: Re: RADiX CAS-Crawler cannot trigger workflow event > >>Dear Prof. Mattmann, >> >> >>I have set all the required environment variables. >> >> >>export OODT_HOME="/Users/AngelaWang/Documents/programs/oodt-0.7" >>export >>CRAWLER_HOME="/Users/AngelaWang/Documents/programs/oodt-0.7/crawler" >>export >>FILEMGR_HOME="/Users/AngelaWang/Documents/programs/oodt-0.7/filemgr" >>export >>WORKFLOW_HOME="/Users/AngelaWang/Documents/programs/oodt-0.7/workflow" >>export PGE_ROOT="/Users/AngelaWang/Documents/programs/oodt-0.7/pge" >>export WORKFLOW_URL="http://localhost:9200"; >>export FILEMGR_URL="http://localhost:9000"; >> >> >> >>It seems the RADiX OODT may not as stable as the original OODT? Thanks. >> >> >>Mengying (Angela) Wang >> >> >>On Sat, Nov 1, 2014 at 10:43 AM, Mattmann, Chris A (3980) >><[email protected]> wrote: >> >>Hi Angela, >> >>This is an issue with you not having your WORKFLOW_URL environment >>variable set. Can you make sure it¹s set before you start the workflow >>manager and RADIX? Please make sure it¹s getting passed down.. >> >>Cheers, >>Chris >> >>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>Chris Mattmann, Ph.D. >>Chief Architect >>Instrument Software and Science Data Systems Section (398) >>NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA >>Office: 168-519, Mailstop: 168-527 >>Email: [email protected] >>WWW: http://sunset.usc.edu/~mattmann/ >>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>Adjunct Associate Professor, Computer Science Department >>University of Southern California, Los Angeles, CA 90089 USA >>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >> >> >> >> >> >> >>-----Original Message----- >>From: MengYing Wang <[email protected]> >>Date: Thursday, October 30, 2014 at 9:30 PM >>To: "[email protected]" <[email protected]> >>Cc: Chris Mattmann <[email protected]> >>Subject: RADiX CAS-Crawler cannot trigger workflow event >> >>>Hi Everyone, >>> >>> >>>I am trying to trigger some workflow evert using the crawler. However, >>>it >>>raises a "no protocol" error: >>> >>> >>>INFO: Performing action (id = TriggerPostIngestWorkflow : description = >>>Triggers workflow event with the name [ProductType]Ingest) >>>Oct 30, 2014 4:41:45 PM org.apache.oodt.cas.crawl.ProductCrawler >>>performProductCrawlerActions >>>WARNING: Failed to perform crawler action : Failed to update workflow >>>manager : no protocol: null >>>org.apache.oodt.cas.crawl.structs.exceptions.CrawlerActionException: >>>Failed to update workflow manager : no protocol: null >>>at >>>org.apache.oodt.cas.crawl.action.WorkflowMgrStatusUpdate.performAction(W >>>o >>>r >>>kflowMgrStatusUpdate.java:59) >>>at >>>org.apache.oodt.cas.crawl.ProductCrawler.performProductCrawlerActions(Pr >>>o >>>d >>>uctCrawler.java:357) >>>at >>>org.apache.oodt.cas.crawl.ProductCrawler.performPostIngestOnSuccessActio >>>n >>>s >>>(ProductCrawler.java:331) >>>at >>>org.apache.oodt.cas.crawl.ProductCrawler.handleFile(ProductCrawler.java: >>>1 >>>9 >>>4) >>>at >>>org.apache.oodt.cas.crawl.ProductCrawler.crawl(ProductCrawler.java:108) >>>at >>>org.apache.oodt.cas.crawl.ProductCrawler.crawl(ProductCrawler.java:75) >>>at >>>org.apache.oodt.cas.crawl.cli.action.CrawlerLauncherCliAction.execute(Cr >>>a >>>w >>>lerLauncherCliAction.java:58) >>>at >>>org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.java:331) >>>at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:187) >>>at >>>org.apache.oodt.cas.crawl.CrawlerLauncher.main(CrawlerLauncher.java:36) >>> >>> >>>It seems some thing wrong with my crawler. Should I do some >>>configuration >>>to my crawler? And how? Thank you for your time and help! >>> >>> >>>-- >>>Best, >>>Mengying (Angela) Wang >>> >>> >>> >>> >> >> >> >> >> >> >> >> >> >> >>-- >>Best, >>Mengying (Angela) Wang >> >> >> > > > > > > > > > > >-- >Best, >Mengying (Angela) Wang > > >
