Thanks Andrea. To file the JIRA ticket, head over to http://issues.apache.org/jira/browse/OODT, register for an account, and then file a new ticket stating that the OODT PGE should print out what keys are actually null before throwing an exception which would be make it easier to debug.
Glad the WM worked! So, now I’m wondering what key is actually null. Can you pass along your batch_stub file that you are running; can you also pass along your PGEConfig.xml file? using something like paste.bin on both would be great b/c I think the M/L strips attachments. Cheers, Chris ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Chris Mattmann, Ph.D. Chief Architect Instrument Software and Science Data Systems Section (398) NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Office: 168-519, Mailstop: 168-527 Email: chris.a.mattm...@nasa.gov WWW: http://sunset.usc.edu/~mattmann/ ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Adjunct Associate Professor, Computer Science Department University of Southern California, Los Angeles, CA 90089 USA ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ -----Original Message----- From: Andrea DeMarco <dr.andrea.dema...@gmail.com> Date: Thursday, June 11, 2015 at 8:13 AM To: jpluser <chris.a.mattm...@jpl.nasa.gov> Cc: "Wyngaard, Jane R (3980-Affiliate)" <jane.r.wynga...@jpl.nasa.gov>, "Starch, Michael D (398M)" <michael.d.sta...@jpl.nasa.gov>, Kristian ZARB ADAMI <k...@astro.ox.ac.uk>, "Ramirez, Paul M (398M)" <paul.m.rami...@jpl.nasa.gov>, Alessio Magro <les...@gmail.com>, "dev@oodt.apache.org" <dev@oodt.apache.org> Subject: Re: OODT Documentation >Hi Chris, > >I have tried with the new batch_stub - same result. Attached is the >oodt.out log file. > >Moreover this is the exception from the batch_stub terminal: > >andrea@issa:~/oodt/resmgr/bin$ ./batch_stub 2001 >[1] 2777 >andrea@issa:~/oodt/resmgr/bin$ Jun 11, 2015 4:56:28 PM >org.apache.oodt.cas.resource.system.extern.XmlRpcBatchStub <init> >INFO: XmlRpc Batch Stub started by andrea >Jun 11, 2015 4:58:38 PM >org.apache.oodt.cas.resource.system.extern.XmlRpcBatchStub >genericExecuteJob >INFO: stub attempting to execute class: >[org.apache.oodt.cas.workflow.structs.TaskJob] >Jun 11, 2015 4:58:38 PM org.apache.oodt.cas.pge.PGETaskInstance >createPgeMetadata >INFO: Converting workflow configuration to static metadata... >Jun 11, 2015 4:58:38 PM org.apache.oodt.cas.pge.PGETaskInstance >createPgeMetadata >INFO: Loading workflow context metadata... >Jun 11, 2015 4:58:38 PM org.apache.oodt.cas.pge.PGETaskInstance >createPgeConfig >INFO: Create PgeConfig... >Jun 11, 2015 4:58:38 PM org.apache.oodt.cas.pge.PGETaskInstance >createPgeConfig >INFO: Using default PgeConfigBuilder: >org.apache.oodt.cas.pge.config.XmlFilePgeConfigBuilder >Jun 11, 2015 4:58:38 PM org.apache.oodt.cas.pge.PGETaskInstance run >SEVERE: PGETask FAILED!!! : Failed to build PgeConfig : Failed to >parse value: null >java.io.IOException: Failed to build PgeConfig : Failed to parse value: >null >at >org.apache.oodt.cas.pge.config.XmlFilePgeConfigBuilder.build(XmlFilePgeCon >figBuilder.java:87) >at >org.apache.oodt.cas.pge.PGETaskInstance.createPgeConfig(PGETaskInstance.ja >va:231) >at org.apache.oodt.cas.pge.PGETaskInstance.run(PGETaskInstance.java:123) >at org.apache.oodt.cas.workflow.structs.TaskJob.execute(TaskJob.java:102) >at >org.apache.oodt.cas.resource.system.extern.XmlRpcBatchStub$RunnableJob.run >(XmlRpcBatchStub.java:229) >at java.lang.Thread.run(Thread.java:745) >Caused by: java.lang.Exception: Failed to parse value: null >at org.apache.oodt.cas.pge.util.XmlHelper.fillIn(XmlHelper.java:501) >at org.apache.oodt.cas.pge.util.XmlHelper.fillIn(XmlHelper.java:480) >at >org.apache.oodt.cas.pge.config.XmlFilePgeConfigBuilder.build(XmlFilePgeCon >figBuilder.java:77) >... 5 more >Caused by: java.lang.NullPointerException >at java.util.regex.Matcher.getTextLength(Matcher.java:1283) >at java.util.regex.Matcher.reset(Matcher.java:309) >at java.util.regex.Matcher.<init>(Matcher.java:229) >at java.util.regex.Pattern.matcher(Pattern.java:1093) >at >org.apache.oodt.cas.metadata.util.PathUtils.doDynamicDateToMillisReplaceme >nt(PathUtils.java:321) >at >org.apache.oodt.cas.metadata.util.PathUtils.doDynamicReplacement(PathUtils >.java:96) >at org.apache.oodt.cas.pge.util.XmlHelper.fillIn(XmlHelper.java:486) >... 7 more > >org.apache.oodt.cas.resource.structs.exceptions.JobInputException: >Failed to run task >at org.apache.oodt.cas.workflow.structs.TaskJob.execute(TaskJob.java:104) >at >org.apache.oodt.cas.resource.system.extern.XmlRpcBatchStub$RunnableJob.run >(XmlRpcBatchStub.java:229) >at java.lang.Thread.run(Thread.java:745) >Caused by: >org.apache.oodt.cas.workflow.structs.exceptions.WorkflowTaskInstanceExcept >ion: >PGETask FAILED!!! : Failed to build PgeConfig : Failed to parse value: >null >at org.apache.oodt.cas.pge.PGETaskInstance.run(PGETaskInstance.java:150) >at org.apache.oodt.cas.workflow.structs.TaskJob.execute(TaskJob.java:102) >... 2 more >Caused by: java.io.IOException: Failed to build PgeConfig : Failed to >parse value: null >at >org.apache.oodt.cas.pge.config.XmlFilePgeConfigBuilder.build(XmlFilePgeCon >figBuilder.java:87) >at >org.apache.oodt.cas.pge.PGETaskInstance.createPgeConfig(PGETaskInstance.ja >va:231) >at org.apache.oodt.cas.pge.PGETaskInstance.run(PGETaskInstance.java:123) >... 3 more >Caused by: java.lang.Exception: Failed to parse value: null >at org.apache.oodt.cas.pge.util.XmlHelper.fillIn(XmlHelper.java:501) >at org.apache.oodt.cas.pge.util.XmlHelper.fillIn(XmlHelper.java:480) >at >org.apache.oodt.cas.pge.config.XmlFilePgeConfigBuilder.build(XmlFilePgeCon >figBuilder.java:77) >... 5 more >Caused by: java.lang.NullPointerException >at java.util.regex.Matcher.getTextLength(Matcher.java:1283) >at java.util.regex.Matcher.reset(Matcher.java:309) >at java.util.regex.Matcher.<init>(Matcher.java:229) >at java.util.regex.Pattern.matcher(Pattern.java:1093) >at >org.apache.oodt.cas.metadata.util.PathUtils.doDynamicDateToMillisReplaceme >nt(PathUtils.java:321) >at >org.apache.oodt.cas.metadata.util.PathUtils.doDynamicReplacement(PathUtils >.java:96) >at org.apache.oodt.cas.pge.util.XmlHelper.fillIn(XmlHelper.java:486) >... 7 more > > > >I have then turned off the resource manager as Valerie suggested, >turned off OODT entirely and restarted the job, and lo and behold, it >worked, and files were ingested successfully! I ran the job a second >time and it worked again...attached also find a log file for this bit >(oodt_2.out) > >Minor progress :) Now to get that resource manager working... >Also: what can I do to file the JIRA ticket you need? > >Cheers, >Andrea
