It worked, see the message: INFO: Successful ingest of product: [/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/pge/file_concatenator/ou tput/jobs/job-2014-11-02T21:21:03.991Z/concatenatedOutputFile-2014-11-02T21 :21:03.991Z.txt]
++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Chris Mattmann, Ph.D. Adjunct Associate Professor, Computer Science Department University of Southern California Los Angeles, CA 90089 USA Email: [email protected] WWW: http://sunset.usc.edu/~mattmann/ ++++++++++++++++++++++++++++++++++++++++++++++++++++++++ -----Original Message----- From: Aakarsh Medleri Hire Math <[email protected]> Date: Sunday, November 2, 2014 at 4:36 PM To: Chris Mattmann <[email protected]> Cc: Gouthami Kondakindi <[email protected]>, Preethi Ramesh <[email protected]>, "[email protected]" <[email protected]> Subject: Re: Assignment2: CAS-PGE file concontenator example FAILURE >Sorry Professor. I had missed a tag in events.xml because of which it was >not identifying the task. > > I got couple of more errors with respect to jars not being in right >place. After fixing them the job went through. > >Now I can see the concatenated file in the output folder, however i dont >get the message saying file was ingested. I get as below. > >Will this be a problem or am I good to go? > > >--------------------------------------------- >aakarsh@aakarsh-VirtualBox:~/Desktop/csci572/oodt-07/oodt-deploy/workflow/ >bin$ ./wmgr-client --url >http://localhost:9001 --operation --sendEvent --eventName >fileconcatenator-pge --metaData --key RunID testNumber1 >Sending event 'fileconcatenator-pge'... SUCCESS >aakarsh@aakarsh-VirtualBox:~/Desktop/csci572/oodt-07/oodt-deploy/workflow/ >bin$ >-------------------------------------------------------------------------- >- > > >I checked the logs for batch_stub and I see this: >------------------------------ >--------------------------------------------- >INFO: Successfully ingested product: >[/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/pge/file_concatenator/o >utput/jobs/job-2014-11-02T21:21:03.991Z/concatenatedOutputFile-2014-11-02T >21:21:03.991Z.txt]: product id: 29919f44-62d6-11e4-8736-abf940e2f70f >Nov 02, 2014 1:21:09 PM org.apache.oodt.cas.crawl.ProductCrawler >handleFile >INFO: Successful ingest of product: >[/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/pge/file_concatenator/o >utput/jobs/job-2014-11-02T21:21:03.991Z/concatenatedOutputFile-2014-11-02T >21:21:03.991Z.txt] >Nov 02, 2014 1:21:09 PM org.apache.oodt.cas.pge.PGETaskInstance >verifyIngests >WARNING: Product was not ingested >[file='/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/pge/file_concaten >ator/output/jobs/job-2014-11-02T21:21:03.991Z/sciPgeExeScript_FileConcaten >ator',result='PRECONDS_FAILED',msg='Failed to pass preconditions'] >Nov 02, 2014 1:21:09 PM org.apache.oodt.cas.pge.PGETaskInstance >verifyIngests >WARNING: Product was not ingested >[file='/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/pge/file_concaten >ator/output/jobs/job-2014-11-02T21:21:03.991Z/concatenatedOutputFile-2014- >11-02T21:21:03.991Z.txt.met',result='PRECONDS_FAILED',msg='Failed to pass >preconditions'] >-------------------------------------------------------------------------- >- > > >Thanks, >Aakarsh > > > >On Sun, Nov 2, 2014 at 11:56 AM, Christian Alan Mattmann ><[email protected]> wrote: > >Hmm, so it sounds like your workflow manager is running, on port 9001, >and that you are sending an event to it via the workflow manager client, >hopefully via http://localhost:9001, correct? If so, you should see the >notice you received in the workflow logs, e.g., Event received for.. > >My question is - did you copy the appropriate policy into events.xml >from the file concatenate pge example? You need that event to be mapped >to your specific workflow and it sounds like it isn¹t. > >Please also include [email protected] on your emails. Thanks. > >Cheers, >Chris > >++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >Chris Mattmann, Ph.D. >Adjunct Associate Professor, Computer Science Department >University of Southern California >Los Angeles, CA 90089 USA >Email: [email protected] >WWW: http://sunset.usc.edu/~mattmann/ >++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > > > >-----Original Message----- >From: Aakarsh Medleri Hire Math <[email protected]> >Date: Sunday, November 2, 2014 at 10:44 AM >To: Chris Mattmann <[email protected]> >Cc: Gouthami Kondakindi <[email protected]>, Preethi Ramesh ><[email protected]> >Subject: Re: Assignment2: CAS-PGE file concontenator example FAILURE > >>It doesnt give me any other error log. >> >> >>The only log I get is in workflow as below: >>Nov 01, 2014 5:35:46 PM >>org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManager handleEvent >>INFO: WorkflowManager: Received event: fileconcatenator-pge >> >> >>The failure doesnt say anything but sending failure like the one in the >>snapshot i sent earlier. >> >>I dont say any events/workflow tasks in the console as well. It is empty. >> >> >> >>Thanks, >>Aakarsh >> >> >>On Sun, Nov 2, 2014 at 9:40 AM, Christian Alan Mattmann >><[email protected]> wrote: >> >>Hm ok workflow manager is running. That verifies that. >> >>Can you suggest what the failure you are getting is? >> >>Cheers, >>Chris >> >>++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>Chris Mattmann, Ph.D. >>Adjunct Associate Professor, Computer Science Department >>University of Southern California >>Los Angeles, CA 90089 USA >>Email: [email protected] >>WWW: http://sunset.usc.edu/~mattmann/ >>++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >> >> >> >> >>-----Original Message----- >>From: Aakarsh Medleri Hire Math <[email protected]> >>Date: Sunday, November 2, 2014 at 10:37 AM >>To: Chris Mattmann <[email protected]> >>Subject: Re: Assignment2: CAS-PGE file concontenator example FAILURE >> >>>telnet localhost 9001 gives this professor: >>>telnet localhost 9001 >>>Trying 127.0.0.1... >>>Connected to localhost. >>>Escape character is '^]'. >>>Connection closed by foreign host. >>> >>> >>> >>>On Sun, Nov 2, 2014 at 8:38 AM, Christian Alan Mattmann >>><[email protected]> wrote: >>> >>>Sorry I meant telnet localhost 9001 >>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>>Chris Mattmann, Ph.D. >>>Adjunct Associate Professor, Computer Science Department >>>University of Southern California >>>Los Angeles, CA 90089 USA >>>Email: [email protected] >>>WWW: http://sunset.usc.edu/~mattmann/ >>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>> >>> >>> >>> >>>-----Original Message----- >>>From: Aakarsh Medleri Hire Math <[email protected]> >>>Date: Saturday, November 1, 2014 at 11:18 PM >>>To: Chris Mattmann <[email protected]> >>>Subject: Re: Assignment2: CAS-PGE file concontenator example FAILURE >>> >>>>Worflow, Resource & File managers are all running professor. >>>> >>>> >>>>telnet 9001 gives me this: >>>>aakarsh@aakarsh-VirtualBox:~/Desktop/csci572/oodt-07/oodt-deploy/workfl >>>>o >>>>w >>>>$ >>>> telnet 9001 >>>>Trying 0.0.35.41... >>>>telnet: Unable to connect to remote host: Invalid argument >>>> >>>> >>>>Thanks, >>>>Aakarsh >>>> >>>> >>>> >>>> >>>>On Sat, Nov 1, 2014 at 10:08 PM, Christian Alan Mattmann >>>><[email protected]> wrote: >>>> >>>>Can you please make sure your Workflow Manager is running? >>>>What happens when you telnet 9001? >>>> >>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>>>Chris Mattmann, Ph.D. >>>>Adjunct Associate Professor, Computer Science Department >>>>University of Southern California >>>>Los Angeles, CA 90089 USA >>>>Email: [email protected] >>>>WWW: http://sunset.usc.edu/~mattmann/ >>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>>> >>>> >>>> >>>> >>>>-----Original Message----- >>>>From: Aakarsh Medleri Hire Math <[email protected]> >>>>Date: Saturday, November 1, 2014 at 6:55 PM >>>>To: Chris Mattmann <[email protected]> >>>>Subject: Assignment2: CAS-PGE file concontenator example FAILURE >>>> >>>>>Hi Professor, >>>>> >>>>> >>>>>I am trying to invoke FileConcatenatorPGE by running the wmgr-client >>>>>and >>>>>I get a failure as below: >>>>> >>>>> >>>>> >>>>> >>>>> >>>>>However, there is no log on what exactly is causing the failure. >>>>> >>>>>I check oodt.out, worflow, file and resource manager logs. There is no >>>>>indication of any errors. >>>>> >>>>> >>>>>Resource manager batch_stub is also running on port 2001. >>>>> >>>>> >>>>>I am stuck here and have exhausted all possible options I could find >>>>>to >>>>>resolve this. >>>>>Could you please help me figure this out? >>>>> >>>>> >>>>>Note: I am running OODT 0.7 and following environment variables are >>>>>being >>>>>set. >>>>>export JAVA_HOME=/usr/lib/jvm/java-7-openjdk-i386/ >>>>>export JCC_JDK=/usr/lib/jvm/java-7-openjdk-i386/ >>>>>export JRE_HOME=/usr/lib/jvm/java-7-openjdk-i386/jre/ >>>>>export OODT_HOME=/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/ >>>>>export >>>>>FILEMGR_HOME=/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/filemgr >>>>>export >>>>>CRAWLER_HOME=/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/crawler >>>>>export >>>>>WORKFLOW_HOME=/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/workfl >>>>>o >>>>>w >>>>>export PGE_ROOT=/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/pge >>>>>export WORKFLOW_URL=http://localhost:9001 >>>>>export FILEMGR_URL=http://localhost:9000 >>>>> >>>>> >>>>> >>>>>Thanks, >>>>>Aakarsh >>>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>> >>> >>> >>> >>> >>> >>> >>> >> >> >> >> >> >> >> >> > > > > > > > >
