I commented out all the ingestion oriented properties(3 properties
described below) in that
part of the push_pull_framework.properties file.
#ingester classpath
org.apache.oodt.cas.filemgr.ingester=org.apache.oodt.cas.filemgr.ingest.StdIngester
#ingester transferer
org.apache.oodt.cas.filemgr.datatransfer.factory=org.apache.oodt.cas.filemgr.datatransfer.LocalDataTransferFactory
# ingester filemgr url
org.apache.oodt.cas.filemgr.url=[FILEMGR_LOC]
But I got the same messages including 1 WARNING and 1 SEVERE after
I commented out the property org.apache.oodt.cas.filemgr.url in
push_pull_framework.properties.
WARNING: Unable to check for existance of product: [null]: Message:
Failure writing request
org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException:
Failure writing request
at
org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.hasProduct(XmlRpcFileManagerClient.java:606)
at
org.apache.oodt.cas.filemgr.ingest.StdIngester.hasProduct(StdIngester.java:284)
at
org.apache.oodt.cas.pushpull.retrievalsystem.FileRetrievalSystem.isAlreadyInDatabase(FileRetrievalSystem.java:254)
at
org.apache.oodt.cas.pushpull.retrievalsystem.FileRetrievalSystem.addToDownloadQueue(FileRetrievalSystem.java:463)
at
org.apache.oodt.cas.pushpull.retrievalmethod.RemoteCrawler.processPropFile(RemoteCrawler.java:138)
at
org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup.retrieveFiles(RetrievalSetup.java:109)
at org.apache.oodt.cas.pushpull.daemon.Daemon$1.run(Daemon.java:218)
at java.lang.Thread.run(Thread.java:662)
Jul 30, 2012 2:46:28 PM
org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup
retrieveFiles
SEVERE: Failed to finish downloading per property files
/home/yhkang/oodt-0.5/cas-pushpull/etc/examples/DirStructXmlParserFiles/TESL2CO2.xml
: [RemoteCrawler] Failed to communicate with database : Failure
writing request
org.apache.oodt.cas.pushpull.exceptions.RetrievalMethodException:
[RemoteCrawler] Failed to communicate with database : Failure writing
request
at
org.apache.oodt.cas.pushpull.retrievalmethod.RemoteCrawler.processPropFile(RemoteCrawler.java:150)
at
org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup.retrieveFiles(RetrievalSetup.java:109)
at org.apache.oodt.cas.pushpull.daemon.Daemon$1.run(Daemon.java:218)
at java.lang.Thread.run(Thread.java:662)
Thanks,
Yunhee
2012/7/30 Mattmann, Chris A (388J) <chris.a.mattm...@jpl.nasa.gov>:
> Hi YunHee,
>
> On Jul 29, 2012, at 4:32 PM, YunHee Kang wrote:
>
>> Hi Chris,
>>
>> When the environment variable FILEMGR was commented, pushpull
>> successfully downloaded a file from the remote side specified in
>> RemoteSpecs.xml. I checked the file was in the staging area as
>> follows:
>> yhkang@yunhee-kisti:~/oodt-0.5/cas-pushpull/staging/TESL2CO2$ ls
>> TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5
>> TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5.info.tmp
>
> Awesome super glad that we were able to solve this for you!
>
>>
>>
>> But I think there is a problem when communicating two parties, File
>> Manager and Pushpull.
>> I commented out the environment variable FILEMGR_LOC and made sure
>> that the File Manager was working well:
>> INFO: Configuring and building ingester:
>> [org.apache.oodt.cas.filemgr.ingest.StdIngester]: data transfer:
>> [org.apache.oodt.cas.filemgr.datatransfer.LocalDataTransferFactory]:
>> to ingest to file manager: [http://localhost:9000]
>>
>> There was a bunch of messages in a log file between File Manager and
>> Pushpull framework by XML-RPC.
>> I think the problem "CatalogException" was caused by the following
>> statement in "XmlRpcFileManagerClient.java".
>> hasProduct = ((Boolean) client.execute("filemgr.hasProduct",
>> argList)).booleanValue();
>
> Hmm, perhaps comment out all the ingestion oriented properties in that
> part of the push_pull_framework.properties file. Then see if you still
> get the same messages?
>
>>
>> Can you give information about how to catalog the file downloaded ?
>
> That information would be here:
>
> http://oodt.apache.org/components/maven/crawler/user/
>
> Good luck!
>
> Cheers,
> Chris
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattm...@nasa.gov
> WWW: http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
