i believe i did this integration for peate before i left... there is a peate-pushpull which depends on cas-pushpull and adds the non-apache protocols... also can you send me your tar.gz of the pushpull you are currently using... and i will see if i can figure out what is going on.
Hey Cam,
On Dec 27, 2011, at 8:48 PM, Cameron Goodale wrote:
> Brian,
>
> Thanks for the info. I don't have my eclipse setup properly to run that
> java file as an application so I will have to try that with some help from
> Paul or Chris next week perhaps.
The best way to run it would be to:
1. cd /usr/local/pushpull
2. java -Djava.ext.dirs=lib org.apache.oodt.cas.pushpull.util.ExpressionValidator
> I looked up the regex for Java and the \w
> is supposed to be a word character matching alphanumeric and underscore.
>
> I ran my regex against this online tool I found and it seems to be a valid
> match.
> http://www.regexplanet.com/advanced/java/index.html
> Regex: TES-Aura_L2-CO2-Nadir_r\d{10}\w{2}\d{2}\w\d{2}\.he5
>
> Input: TES-Aura_L2-CO2-Nadir_r0000002931_F06_08.he5
>
>
> Thanks for the feedback and help on this. I have tried so many different
> tweaks with backslashes, etc. I am going to just walk away now and look at
> it later.
I think it's a protocol issue. Let me see if I can throw up those LGPL plugins
somewhere b/c we can't host them at Apache. Or better yet, if folks have a
better ALv2 compatible FTP library, I'll happily write a PushPull plugin and
integrate it.
Cheers,
Chris
>
>
> -Cam
>
>
> On Tue, Dec 27, 2011 at 2:58 PM, Brian Foster <[email protected]> wrote:
>
>> Hey cameron.. I think the problem is with ur
>> DirStructXmlParserFiles/TESL2CO2.xml file... for the file name regExp u are
>> specifying whitespace (i.e. \w instead of underscore)... pushpull looks
>> like it is behaving normally... it is acting like it is not finding any
>> files that match ur regExps... I wrote an app which may help u with your
>> regular expressions... in the pushpull util package in eclipse right click
>> on ExpressionValidator.java and Run As: Java Application... you can test
>> your regExp in the GUI that pops up.
>>
>> -brian
>>
>> Cameron Goodale <[email protected]> wrote:
>>
>>> Hey Devs,
>>>
>>> I have been working on building an OODT PushPull User Guide from an
>> Example
>>> I am trying to get working for a project, and I have encountered a little
>>> issue (at least I hope it is little).
>>>
>>> Here is the guide (work in progress):
>>>
>> https://cwiki.apache.org/confluence/display/OODT/OODT+Push-Pull+User+Guide
>>>
>>> The setups listed in the User Guide are the same ones I am working
>> against.
>>> Now here is the log messages I am seeing.
>>>
>>> Dec 27, 2011 10:59:00 AM org.apache.oodt.cas.pushpull.daemon.DaemonManager
>>> setAsRunning
>>> INFO: Daemon with ID = 91131 was given permission to run
>>> org.apache.oodt.cas.pushpull.filerestrictions.parsers.DirStructXmlParser
>>> Dec 27, 2011 10:59:00 AM
>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler isOkProtocol
>>> INFO: Testing protocol
>>> org.apache.oodtcas.pushpull.protocol.ftp.CogJGlobusFtpClient . . . this
>>> may take a few minutes . . .
>>> Dec 27, 2011 10:59:00 AM org.apache.oodt.cas.pushpull.protocol.Protocol
>>> cdToHOME
>>> INFO: Changing to HOME directory 'ftp://l4ftl01.larc.nasa.gov/isDir=true'
>>> Dec 27, 2011 10:59:00 AM
>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler isOkProtocol
>>> SEVERE: Protocol
>>> org.apache.oodt.cas.pushpull.protocol.ftp.CogJGlobusFtpClient failed
>>> compatibility test : [CogJGlobusFtpClient] Failed to get list of files :
>>> Server refused performing the request. Custom message: (error code 1)
>>> [Nested exception message: Custom message: Unexpected reply: 500 'ORT
>>> 97,93,139,127,210,161': command not understood.]
>>> Dec 27, 2011 10:59:00 AM
>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler
>>> getAppropriateProtocolBySite
>>> WARNING: ProtocolFactory
>>> org.apache.oodt.cas.pushpull.protocol.ftp.CogJGlobusFtpClientFactory is
>> not
>>> compatible with server at ftp://l4ftl01.larc.nasa.gov
>>> Dec 27, 2011 10:59:01 AM
>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler isOkProtocol
>>> INFO: Testing protocol
>>> org.apache.oodt.cas.pushpull.protocol.ftp.CommonsNetFtpClient . . . this
>>> may take a few minutes . . .
>>> Dec 27, 2011 10:59:01 AM org.apache.oodt.cas.pushpull.protocol.Protocol
>>> cdToHOME
>>> INFO: Changing to HOME directory 'ftp://l4ftl01.larc.nasa.gov/isDir=true'
>>> Dec 27, 2011 10:59:02 AM org.apache.oodt.cas.pushpull.protocol.Protocol
>>> cdToROOT
>>> INFO: Changing to ROOT directory '/'
>>> Dec 27, 2011 10:59:02 AM org.apache.oodt.cas.pushpull.protocol.Protocol
>>> cdToHOME
>>> INFO: Changing to HOME directory 'ftp://l4ftl01.larc.nasa.gov/isDir=true'
>>> Dec 27, 2011 10:59:02 AM
>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler connect
>>> INFO: Successfully connected to ftp://l4ftl01.larc.nasa.gov with protocol
>>> 'org.apache.oodt.cas.pushpull.protocol.ftp.CommonsNetFtpClient' and
>>> username 'anonymous'
>>> Dec 27, 2011 10:59:02 AM org.apache.oodt.cas.pushpull.protocol.Protocol cd
>>> INFO: Changing to directory
>>> 'ftp://l4ftl01.larc.nasa.gov/TES/TL2CO2N.005isDir=true'
>>> PageSize: 8 PageLoc: 0
>>> FileList size: 491
>>> Dec 27, 2011 10:59:03 AM
>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler disconnect
>>> INFO: Disconnecting protocol from ftp://l4ftl01.larc.nasa.gov
>>> Dec 27, 2011 10:59:03 AM org.apache.oodt.cas.pushpull.daemon.Daemon sleep
>>> INFO: Daemon with ID = 91131 on RMI registry port 9113 is going to sleep
>>> until Tue Dec 27 11:00:00 PST 2011
>>>
>>>
>>> First PushPull tries to use the CogJGlobusFtpClient and it encounters an
>>> error so it switches to CommonsNetFtpClient does a couple cd commands,
>>> connects successfully then disconnects and goes back to sleep. It will
>>> then wake up after the 3 minutes and repeat the same process. Has anyone
>>> seen this issue or have any suggestions for a fix?
>>>
>>> Thank you in advance.
>>>
>>> -Cameron
>>>
>>> P.S. If you have any feedback on the PushPull User Guide be sure to leave
>>> comments or make changes to the wiki.
>>
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: [email protected]
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
