Hi Bill, Thanks for the reply, mine are inline below:
-----Original Message----- From: Bill Rideout <bride...@haystack.mit.edu> Reply-To: "user@oodt.apache.org" <user@oodt.apache.org> Date: Friday, June 21, 2013 10:56 AM To: "user@oodt.apache.org" <user@oodt.apache.org> Subject: Re: Trouble with CAS-PGE Learn by Example > > > >Chris, > > >I was working on the Curation example, so just got back the the CAS-PGE >example. For the Curation example I got all but the last step working, >but I'll discuss that in a separate email. Got, it, and saw that Cam replied already. Let me know if you need more help on the Curation one. > > >For CAS-PGE, I have two separate installations. The first is on a mac, >where I did everything using OODT release 0.3, since that is what the >example seems to use. The error I get now is: My suggestion would be to do the following: 1. Use trunk (0.6-SNAPSHOT) 2. Use CAS-PGE 0.3 (release) (to do this simply copy the CAS-PGE jar into workflow manager's lib/ dir, and file manager's lib/ dir, and crawler's lib/ dir and resource manager's lib/dir > > > >dhcp28:bin brideout$ ./wmgr-client --url http://localhost:9001 >--operation --sendEvent --eventName fileconcatenator-pge --metaData --key >RunID testNumber1 >Picked up metadata: [key=RunID, values=[testNumber1]] >Jun 21, 2013 1:45:05 PM sun.net.www.protocol.http.HttpURLConnection >writeRequests >FINE: sun.net.www.MessageHeader@7d2a1e449 pairs: {POST / HTTP/1.1: >null}{Content-Type: text/xml}{Cache-Control: no-cache}{Pragma: >no-cache}{User-Agent: Java/1.6.0_45}{Host: localhost:9001}{Accept: >text/html, image/gif, image/jpeg, *; q=.2, */*; q=.2}{Connection: > keep-alive}{Content-Length: 312} >Jun 21, 2013 1:45:05 PM >org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManager handleEvent >INFO: WorkflowManager: Received event: fileconcatenator-pge >Jun 21, 2013 1:45:05 PM sun.net.www.protocol.http.HttpURLConnection >getInputStream >FINE: sun.net.www.MessageHeader@50ef55025 pairs: {null: HTTP/1.1 200 >OK}{Server: Apache XML-RPC 1.0}{Connection: close}{Content-Type: >text/xml}{Content-Length: 121} The above doesn't look like an error, just overly verbose log messages. To get rid of them, add the following lines to your etc/logging.properties file inside of workflow manager's deploy dir: # control the underlying commons-httpclient transport layer for xmlrpc org.apache.commons.httpclient.level = INFO httpclient.wire.header.level = INFO httpclient.wire.level = INFO sun.net.level = OFF sun.net.www.level = OFF # spring framework logging org.springframework.beans.level = SEVERE org.springframework.core.level = SEVERE org.springframework.level = SEVERE org.springframework.beans.factory.level = SEVERE org.springframework.beans.factory.config.level = SEVERE org.springframework.beans.factory.config.PropertyPlaceholderConfigurer.leve l = SEVERE org.apache.oodt.cas.crawl.util.CasPropertyPlaceholderConfigurer.level = SEVERE sun.net.level = SEVERE (note these logging levels are present in http://svn.apache.org/repos/asf/oodt/trunk/workflow/src/main/resources/logg ing.properties and in the 0.5 workflow logging.properties which is why those extra logging messages aren't shown). What looks like is happening is that the 0.3 workflow manager received the event for the file concatenator PGE, but just never ran it, see: INFO: WorkflowManager: Received event: fileconcatenator-pge The next thing you should see is something like you see in 0.5: Jun 21, 2013 1:25:06 PM org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManager handleEvent INFO: WorkflowManager: Workflow FileConcatenatorWorkflow retrieved for event fileconcatenator-pge > > > > > >On linux I tried using OODT release 0.5, except that fileconcatenator is >0.3 (after editing pom.xml to change 0.3-SNAPSHOT to 0.3). Got it, yeah not sure about the 0.3-SNAPSHOT (I think the example guide Rishi wrote is a bit out of date). The best thing we can do here is to try and update the wiki to show how to do the tutorial currently so if no one else does, I'll get on that. > Here's the error that is presently giving: > > > >pre-col1:/home/pre-col1/brideout/OODT/OODT-0.5/oodt/oodt/cas-workflow/bin >> ./wmgr-client --url >http://localhost:9001 --operation --sendEvent --eventName >fileconcatenator-pge --metaData --key RunID testNumber1 >Jun 21, 2013 1:25:06 PM >org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManager handleEvent >INFO: WorkflowManager: Received event: fileconcatenator-pge >Jun 21, 2013 1:25:06 PM >org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManager handleEvent >INFO: WorkflowManager: Workflow FileConcatenatorWorkflow retrieved for >event fileconcatenator-pge >Sending event 'fileconcatenator-pge'... SUCCESS > > >pre-col1:/home/pre-col1/brideout/OODT/OODT-0.5/oodt/oodt/cas-workflow/bin >> Jun 21, 2013 1:25:06 PM >>org.apache.oodt.cas.workflow.engine.IterativeWorkflowProcessorThread >>checkTaskRequiredMetadata >INFO: All required metadata fields present for task: [FileConcatenator] >Jun 21, 2013 1:25:06 PM >org.apache.oodt.cas.workflow.engine.IterativeWorkflowProcessorThread >executeTaskLocally >INFO: Executing task: [FileConcatenator] locally >java.lang.NullPointerException >at org.apache.oodt.cas.pge.PGETaskInstance.run(PGETaskInstance.java:139) >at >org.apache.oodt.cas.workflow.engine.IterativeWorkflowProcessorThread.execu >teTaskLocally(IterativeWorkflowProcessorThread.java:573) >at >org.apache.oodt.cas.workflow.engine.IterativeWorkflowProcessorThread.run(I >terativeWorkflowProcessorThread.java:320) >at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown >Source) >at java.lang.Thread.run(Thread.java:679) >Jun 21, 2013 1:25:06 PM >org.apache.oodt.cas.workflow.engine.IterativeWorkflowProcessorThread >executeTaskLocally >WARNING: Exception executing task: [FileConcatenator] locally: Message: >null > Yep this is a known 0.5 bug, fixed in 0.6 trunk (sorry about that): https://issues.apache.org/jira/browse/OODT-584 My suggestion would be to try the latest trunk 0.6-SNAPSHOT (with CAS-PGE 0.3) and I think that will fix your issues. Sorry about all the trouble. We'll get it going. Cheers, Chris ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Chris Mattmann, Ph.D. Senior Computer Scientist NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Office: 171-266B, Mailstop: 171-246 Email: chris.a.mattm...@nasa.gov WWW: http://sunset.usc.edu/~mattmann/ ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Adjunct Assistant Professor, Computer Science Department University of Southern California, Los Angeles, CA 90089 USA ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > >On Jun 20, 2013, at 2:04 PM, Mattmann, Chris A (398J) wrote: > > >Hey Bill, > >Did Cam's email get you past your stop point? Need any more help? > >Cheers, >Chris > >++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >Chris Mattmann, Ph.D. >Senior Computer Scientist >NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA >Office: 171-266B, Mailstop: 171-246 >Email: chris.a.mattm...@nasa.gov >WWW: http://sunset.usc.edu/~mattmann/ >++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >Adjunct Assistant Professor, Computer Science Department >University of Southern California, Los Angeles, CA 90089 USA >++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > > > > > >-----Original Message----- >From: Bill Rideout <bride...@haystack.mit.edu> >Reply-To: "user@oodt.apache.org" <user@oodt.apache.org> >Date: Monday, June 17, 2013 7:38 AM >To: "user@oodt.apache.org" <user@oodt.apache.org> >Subject: Trouble with CAS-PGE Learn by Example > > >I've been trying the "CAS-PGE Learn by Example" page at > > > >https://cwiki.apache.org/confluence/display/OODT/CAS-PGE+Learn+by+Example. > > > >I've went through the installation instructions in two ways: using the > > > >0.6-SNAPSHOT release, and using the 0.3 release (since that seemed to be > > > >the one the author of the example used). Both times I got an error when > > > >I run the test: > > > > > > > >./wmgr-client --url http://localhost:9001 --operation --sendEvent > > > >--eventName fileconcatenator-pge --metaData --key RunID testNumber1 > > > > > > > >Here's the traceback from the 0.3 version: > > > > > > > >dhcp28:bin brideout$ ./wmgr-client --url >http://localhost:9001 <http://localhost:9001> > > > >--operation --sendEvent --eventName fileconcatenator-pge --metaData --key > > > >RunID testNumber1 > > > >Picked up metadata: [key=RunID, values=[testNumber1]] > > > >Jun 14, 2013 5:00:38 PM sun.net.www.protocol.http.HttpURLConnection > > > >writeRequests > > > >FINE: sun.net.www.MessageHeader@7d2a1e449 pairs: {POST / HTTP/1.1: > > > >null}{Content-Type: text/xml}{Cache-Control: no-cache}{Pragma: > > > >no-cache}{User-Agent: Java/1.6.0_45}{Host: localhost:9001}{Accept: > > > >text/html, image/gif, image/jpeg, *; q=.2, */*; q=.2}{Connection: > > > >keep-alive}{Content-Length: 312} > > > >Jun 14, 2013 5:00:38 PM > > > >org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManager handleEvent > > > >INFO: WorkflowManager: Received event: fileconcatenator-pge > > > >Jun 14, 2013 5:00:38 PM > > > >org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManager handleEvent > > > >INFO: WorkflowManager: Workflow FileConcatenatorWorkflow retrieved for > > > >event fileconcatenator-pge > > > >Jun 14, 2013 5:00:39 PM > > > >org.apache.oodt.cas.workflow.instrepo.LuceneWorkflowInstanceRepository > > > >addWorkflowInstanceToCatalog > > > >WARNING: Unable to index workflow instance: > > > >[770bc822-d535-11e2-8789-a9014efdd41f]: Message: Lock obtain timed out: > > > >Lock@/var/folders/ch/b0hwg9sj3x382j2mmjc8jjsc0000gn/T/lucene-db9284b776af4 > > > >c21082c547aaab929a3-write.lock > > > >org.apache.oodt.cas.workflow.structs.exceptions.InstanceRepositoryExceptio > > > >n: Unable to index workflow instance: > > > >[770bc822-d535-11e2-8789-a9014efdd41f]: Message: Lock obtain timed out: > > > >Lock@/var/folders/ch/b0hwg9sj3x382j2mmjc8jjsc0000gn/T/lucene-db9284b776af4 > > > >c21082c547aaab929a3-write.lock > > > >at > > > > >org.apache.oodt.cas.workflow.instrepo.LuceneWorkflowInstanceRepository.add > > > >WorkflowInstanceToCatalog(LuceneWorkflowInstanceRepository.java:462) > > > >at > > > > >org.apache.oodt.cas.workflow.instrepo.LuceneWorkflowInstanceRepository.add > > > >WorkflowInstance(LuceneWorkflowInstanceRepository.java:175) > > > >at > > > > >org.apache.oodt.cas.workflow.engine.ThreadPoolWorkflowEngine.persistWorkfl > > > >owInstance(ThreadPoolWorkflowEngine.java:435) > > > >at > > > > >org.apache.oodt.cas.workflow.engine.ThreadPoolWorkflowEngine.startWorkflow > > > >(ThreadPoolWorkflowEngine.java:202) > > > >at > > > > >org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManager.handleEvent(XmlR > > > >pcWorkflowManager.java:315) > > > >at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > > >at > > > > >sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java: > > > >39) > > > >at > > > > >sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm > > > >pl.java:25) > > > >at java.lang.reflect.Method.invoke(Method.java:597) > > > >at org.apache.xmlrpc.Invoker.execute(Invoker.java:130) > > > >at org.apache.xmlrpc.XmlRpcWorker.invokeHandler(XmlRpcWorker.java:84) > > > >at org.apache.xmlrpc.XmlRpcWorker.execute(XmlRpcWorker.java:146) > > > >at org.apache.xmlrpc.XmlRpcServer.execute(XmlRpcServer.java:139) > > > >at org.apache.xmlrpc.XmlRpcServer.execute(XmlRpcServer.java:125) > > > >at org.apache.xmlrpc.WebServer$Connection.run(WebServer.java:761) > > > >at org.apache.xmlrpc.WebServer$Runner.run(WebServer.java:642) > > > >at java.lang.Thread.run(Thread.java:680) > > > >org.apache.oodt.cas.workflow.structs.exceptions.EngineException: Unable > > > >to index workflow instance: [770bc822-d535-11e2-8789-a9014efdd41f]: > > > >Message: Lock obtain timed out: > > > >Lock@/var/folders/ch/b0hwg9sj3x382j2mmjc8jjsc0000gn/T/lucene-db9284b776af4 > > > >c21082c547aaab929a3-write.lock > > > >at > > > > >org.apache.oodt.cas.workflow.engine.ThreadPoolWorkflowEngine.persistWorkfl > > > >owInstance(ThreadPoolWorkflowEngine.java:443) > > > >at > > > > >org.apache.oodt.cas.workflow.engine.ThreadPoolWorkflowEngine.startWorkflow > > > >(ThreadPoolWorkflowEngine.java:202) > > > >at > > > > >org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManager.handleEvent(XmlR > > > >pcWorkflowManager.java:315) > > > >at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > > >at > > > > >sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java: > > > >39) > > > >at > > > > >sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm > > > >pl.java:25) > > > >at java.lang.reflect.Method.invoke(Method.java:597) > > > >at org.apache.xmlrpc.Invoker.execute(Invoker.java:130) > > > >at org.apache.xmlrpc.XmlRpcWorker.invokeHandler(XmlRpcWorker.java:84) > > > >at org.apache.xmlrpc.XmlRpcWorker.execute(XmlRpcWorker.java:146) > > > >at org.apache.xmlrpc.XmlRpcServer.execute(XmlRpcServer.java:139) > > > >at org.apache.xmlrpc.XmlRpcServer.execute(XmlRpcServer.java:125) > > > >at org.apache.xmlrpc.WebServer$Connection.run(WebServer.java:761) > > > >at org.apache.xmlrpc.WebServer$Runner.run(WebServer.java:642) > > > >at java.lang.Thread.run(Thread.java:680) > > > >Jun 14, 2013 5:00:39 PM sun.net.www.protocol.http.HttpURLConnection > > > >getInputStream > > > >FINE: sun.net.www.MessageHeader@50ef55025 pairs: {null: HTTP/1.1 200 > > > >OK}{Server: Apache XML-RPC 1.0}{Connection: close}{Content-Type: > > > >text/xml}{Content-Length: 596} > > > >org.apache.xmlrpc.XmlRpcException: java.lang.Exception: > > > >org.apache.oodt.cas.workflow.structs.exceptions.EngineException: Engine > > > >exception when starting workflow: FileConcatenatorWorkflow: Message: > > > >Unable to index workflow instance: > > > >[770bc822-d535-11e2-8789-a9014efdd41f]: Message: Lock obtain timed out: > > > >Lock@/var/folders/ch/b0hwg9sj3x382j2mmjc8jjsc0000gn/T/lucene-db9284b776af4 > > > >c21082c547aaab929a3-write.lock > > > >at > > > > >org.apache.xmlrpc.XmlRpcClientResponseProcessor.decodeException(XmlRpcClie > > > >ntResponseProcessor.java:104) > > > >at > > > > >org.apache.xmlrpc.XmlRpcClientResponseProcessor.decodeResponse(XmlRpcClien > > > >tResponseProcessor.java:71) > > > >at > > > > >org.apache.xmlrpc.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:73) > > > >at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:194) > > > >at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:185) > > > >at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:178) > > > >at > > > > >org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManagerClient.sendEvent( > > > >XmlRpcWorkflowManagerClient.java:443) > > > >at > > > > >org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManagerClient.main(XmlRp > > > >cWorkflowManagerClient.java:763) > > > >java.lang.Exception: java.lang.Exception: > > > >org.apache.oodt.cas.workflow.structs.exceptions.EngineException: Engine > > > >exception when starting workflow: FileConcatenatorWorkflow: Message: > > > >Unable to index workflow instance: > > > >[770bc822-d535-11e2-8789-a9014efdd41f]: Message: Lock obtain timed out: > > > >Lock@/var/folders/ch/b0hwg9sj3x382j2mmjc8jjsc0000gn/T/lucene-db9284b776af4 > > > >c21082c547aaab929a3-write.lock > > > >at > > > > >org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManagerClient.sendEvent( > > > >XmlRpcWorkflowManagerClient.java:448) > > > >at > > > > >org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManagerClient.main(XmlRp > > > >cWorkflowManagerClient.java:763) > > > >Exception in thread "main" java.lang.RuntimeException: > > > >java.lang.Exception: java.lang.Exception: > > > >org.apache.oodt.cas.workflow.structs.exceptions.EngineException: Engine > > > >exception when starting workflow: FileConcatenatorWorkflow: Message: > > > >Unable to index workflow instance: > > > >[770bc822-d535-11e2-8789-a9014efdd41f]: Message: Lock obtain timed out: > > > >Lock@/var/folders/ch/b0hwg9sj3x382j2mmjc8jjsc0000gn/T/lucene-db9284b776af4 > > > >c21082c547aaab929a3-write.lock > > > >at > > > > >org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManagerClient.main(XmlRp > > > >cWorkflowManagerClient.java:766) > > > >Caused by: java.lang.Exception: java.lang.Exception: > > > >org.apache.oodt.cas.workflow.structs.exceptions.EngineException: Engine > > > >exception when starting workflow: FileConcatenatorWorkflow: Message: > > > >Unable to index workflow instance: > > > >[770bc822-d535-11e2-8789-a9014efdd41f]: Message: Lock obtain timed out: > > > >Lock@/var/folders/ch/b0hwg9sj3x382j2mmjc8jjsc0000gn/T/lucene-db9284b776af4 > > > >c21082c547aaab929a3-write.lock > > > >at > > > > >org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManagerClient.sendEvent( > > > >XmlRpcWorkflowManagerClient.java:448) > > > >at > > > > >org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManagerClient.main(XmlRp > > > >cWorkflowManagerClient.java:763) > > > >dhcp28:bin brideout$ > > > > > > > >Any suggestions? > > > > > > > >Thanks - Bill Rideout > > > > > > > > > >!DSPAM:51c34453190915744860! > > > > > > >
