No data files are downloaded using Apache OODT Pushpull

[Mengying Wang]

Dear Everyone,

I am trying to use the Apache OODT Pushpull to download some remote data
files to my local machine. According to the Apache OODT Pushpull user guide
(https://cwiki.apache.org/confluence/display/OODT/OODT+Push-Pull+User+Guide),
I have completed all steps. However, when I run the command ./pushpull, no
data files are downloaded to my staging area after 15 minutes. I have used
FileZilla to login to the remove server and confirmed that there are some
data files. So I am not sure what is wrong with my configurations? Could
you please help me out? Many thanks!

Following are my running screenshot and configuration details:

$ ./pushpull

TRANSFER: org.apache.oodt.cas.filemgr.datatransfer.LocalDataTransferFactory

^C

*[CAS_PP_HOME]/etc/push_pull_framework.properties*
line
21   #external configuration files
22
org.apache.oodt.cas.pushpull.config.external.properties.files=[CAS_PP_HOME]/etc/default.properties

35   # ingester filemgr url
36   org.apache.oodt.cas.filemgr.url=http://localhost:9000

61   #protocolfactory specification for protocol types
62
org.apache.oodt.cas.pushpull.config.protocolfactory.info.files=[CAS_PP_HOME]/policy/ProtocolFactoryInfo.xml

69   #parser to retrievalmethod map
70
org.apache.oodt.cas.pushpull.config.parser.info.files=[CAS_PP_HOME]/policy/ParserToRetrievalMethodMap.xml
71
72   #unique metadata element info
73
org.apache.oodt.cas.pushpull.config.type.detection.file=[CAS_PP_HOME]/policy/mimetypes.xml
74
75   #directory below which all data file will be downloaded to
76
org.apache.oodt.cas.pushpull.data.files.base.staging.area=[CAS_PP_HOME]/staging


*[CAS_PP_HOME]/policy/mimetypes.xml*
<mime-type type="product/rtg_sst">
    <sub-class-of type="ncep/model"/>
    <_comment><![CDATA[ProductType=RTG_SST &&
UniqueElement=RetrievedFromLoc]]></_comment>
    <glob pattern="rtg_sst_grb_0\.5\.\d{8}" isregex="true"/>
    <glob pattern="sst\.\d{8}_rtgssthr_grb_0\.5\.grib2" isregex="true"/>
</mime-type>

*[CAS_PP_HOME]/etc/examples/ExternalSourcesFiles/ExternalSources.xml*
<sources>
    <source host="polar.ncep.noaa.gov">
        <login type="ftp" alias="PolarNcepNoaaFtp">
            <username>anonymous</username>
            <password>u...@host.com</password>
        </login>
    </source>
</sources>

*[CAS_PP_HOME]/etc/examples/RemoteSpecsFiles/RemoteSpecs.xml*
<remoteSpecs>
    <aliasSpecs>
        <aliasSpec
file="[CAS_PP_HOME]/etc/examples/ExternalSources/ExternalSources.xml"/>
    </aliasSpecs>

    <daemons>
        <daemon alias="PolarNcepNoaaFtp" active="no">
            <runInfo firstRunDateTime="2007-11-27T00:00:00Z" period="3m"
epsilon="20s" runOnReboot="yes"/>
            <propInfo
dir="/Users/AngelaWang/Documents/programs/oodt/cas-pushpull/etc/examples/DirStructXmlParserFiles">
                <propFiles regExp="RTG_SST\.xml"
parser="org.apache.oodt.cas.pushpull.filerestrictions.parsers.DirStructXmlParser"/>
            </propInfo>
            <dataInfo stagingArea="RtgSstFtp" queryElement="Filename"/>
        </daemon>
    </daemons>
</remoteSpecs>

*[CAS_PP_HOME]/etc/examples/DirStructXmlParserFiles/RTG_SST.xml*
<root>
    <dirstruct starting_path="/history/sst">
        <nodirs/>
        <file name="rtg_sst_grb_0\.5\.\d{8}"/>
    </dirstruct>
</root>

Thanks again!

Best,
Angela Wang