Hey Cam, OK, I created an Apache Extras project here:
http://code.google.com/a/apache-extras.org/p/oodt-pushpull-plugins/ You can download and use these plugins by doing: 1. svn export http://svn.codespot.com/a/apache-extras.org/oodt-pushpull-plugins/trunk/ oodt-pushpull-plugins 2. cd oodt-pushpull-plugins 3. mvn install Then you'll have a Jar file called oodt-pushpull-plugins-core-0.4-SNAPSHOT.jar. You can use it 2 days: 1. drop that Jar file into $PUSHPULL_HOME/lib, and then reference the new FTP plugins in the PushPull Protocols.xml file. 2. use it in your Maven2 project by adding a dependency on: <dependency> <groupId>org.apache.oodt</groupId> <artifactId>oodt-pushpull-plugins-core</artifactId> <version>0.4-SNAPSHOT</version> </dependency> If any of the OODT PMC/committers want to be made an admin on this project at Apache Extras, let me know. Thanks! Cheers, Chris On Dec 27, 2011, at 8:48 PM, Cameron Goodale wrote: > Brian, > > Thanks for the info. I don't have my eclipse setup properly to run that > java file as an application so I will have to try that with some help from > Paul or Chris next week perhaps. I looked up the regex for Java and the \w > is supposed to be a word character matching alphanumeric and underscore. > > I ran my regex against this online tool I found and it seems to be a valid > match. > http://www.regexplanet.com/advanced/java/index.html > Regex: TES-Aura_L2-CO2-Nadir_r\d{10}\w{2}\d{2}\w\d{2}\.he5 > > Input: TES-Aura_L2-CO2-Nadir_r0000002931_F06_08.he5 > > > Thanks for the feedback and help on this. I have tried so many different > tweaks with backslashes, etc. I am going to just walk away now and look at > it later. > > > -Cam > > > On Tue, Dec 27, 2011 at 2:58 PM, Brian Foster <[email protected]> wrote: > >> Hey cameron... I think the problem is with ur >> DirStructXmlParserFiles/TESL2CO2.xml file... for the file name regExp u are >> specifying whitespace (i.e. \w instead of underscore)... pushpull looks >> like it is behaving normally... it is acting like it is not finding any >> files that match ur regExps... I wrote an app which may help u with your >> regular expressions... in the pushpull util package in eclipse right click >> on ExpressionValidator.java and Run As: Java Application... you can test >> your regExp in the GUI that pops up. >> >> -brian >> >> Cameron Goodale <[email protected]> wrote: >> >>> Hey Devs, >>> >>> I have been working on building an OODT PushPull User Guide from an >> Example >>> I am trying to get working for a project, and I have encountered a little >>> issue (at least I hope it is little). >>> >>> Here is the guide (work in progress): >>> >> https://cwiki.apache.org/confluence/display/OODT/OODT+Push-Pull+User+Guide >>> >>> The setups listed in the User Guide are the same ones I am working >> against. >>> Now here is the log messages I am seeing. >>> >>> Dec 27, 2011 10:59:00 AM org.apache.oodt.cas.pushpull.daemon.DaemonManager >>> setAsRunning >>> INFO: Daemon with ID = 91131 was given permission to run >>> org.apache.oodt.cas.pushpull.filerestrictions.parsers.DirStructXmlParser >>> Dec 27, 2011 10:59:00 AM >>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler isOkProtocol >>> INFO: Testing protocol >>> org.apache.oodt.cas.pushpull.protocol.ftp.CogJGlobusFtpClient . . . this >>> may take a few minutes . . . >>> Dec 27, 2011 10:59:00 AM org.apache.oodt.cas.pushpull.protocol.Protocol >>> cdToHOME >>> INFO: Changing to HOME directory 'ftp://l4ftl01.larc.nasa.gov/isDir=true' >>> Dec 27, 2011 10:59:00 AM >>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler isOkProtocol >>> SEVERE: Protocol >>> org.apache.oodt.cas.pushpull.protocol.ftp.CogJGlobusFtpClient failed >>> compatibility test : [CogJGlobusFtpClient] Failed to get list of files : >>> Server refused performing the request. Custom message: (error code 1) >>> [Nested exception message: Custom message: Unexpected reply: 500 'ORT >>> 97,93,139,127,210,161': command not understood.] >>> Dec 27, 2011 10:59:00 AM >>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler >>> getAppropriateProtocolBySite >>> WARNING: ProtocolFactory >>> org.apache.oodt.cas.pushpull.protocol.ftp.CogJGlobusFtpClientFactory is >> not >>> compatible with server at ftp://l4ftl01.larc.nasa.gov >>> Dec 27, 2011 10:59:01 AM >>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler isOkProtocol >>> INFO: Testing protocol >>> org.apache.oodt.cas.pushpull.protocol.ftp.CommonsNetFtpClient . . . this >>> may take a few minutes . . . >>> Dec 27, 2011 10:59:01 AM org.apache.oodt.cas.pushpull.protocol.Protocol >>> cdToHOME >>> INFO: Changing to HOME directory 'ftp://l4ftl01.larc.nasa.gov/isDir=true' >>> Dec 27, 2011 10:59:02 AM org.apache.oodt.cas.pushpull.protocol.Protocol >>> cdToROOT >>> INFO: Changing to ROOT directory '/' >>> Dec 27, 2011 10:59:02 AM org.apache.oodt.cas.pushpull.protocol.Protocol >>> cdToHOME >>> INFO: Changing to HOME directory 'ftp://l4ftl01.larc.nasa.gov/isDir=true' >>> Dec 27, 2011 10:59:02 AM >>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler connect >>> INFO: Successfully connected to ftp://l4ftl01.larc.nasa.gov with protocol >>> 'org.apache.oodt.cas.pushpull.protocol.ftp.CommonsNetFtpClient' and >>> username 'anonymous' >>> Dec 27, 2011 10:59:02 AM org.apache.oodt.cas.pushpull.protocol.Protocol cd >>> INFO: Changing to directory >>> 'ftp://l4ftl01.larc.nasa.gov/TES/TL2CO2N.005isDir=true' >>> PageSize: 8 PageLoc: 0 >>> FileList size: 491 >>> Dec 27, 2011 10:59:03 AM >>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler disconnect >>> INFO: Disconnecting protocol from ftp://l4ftl01.larc.nasa.gov >>> Dec 27, 2011 10:59:03 AM org.apache.oodt.cas.pushpull.daemon.Daemon sleep >>> INFO: Daemon with ID = 91131 on RMI registry port 9113 is going to sleep >>> until Tue Dec 27 11:00:00 PST 2011 >>> >>> >>> First PushPull tries to use the CogJGlobusFtpClient and it encounters an >>> error so it switches to CommonsNetFtpClient does a couple cd commands, >>> connects successfully then disconnects and goes back to sleep. It will >>> then wake up after the 3 minutes and repeat the same process. Has anyone >>> seen this issue or have any suggestions for a fix? >>> >>> Thank you in advance. >>> >>> -Cameron >>> >>> P.S. If you have any feedback on the PushPull User Guide be sure to leave >>> comments or make changes to the wiki. >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Chris Mattmann, Ph.D. Senior Computer Scientist NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Office: 171-266B, Mailstop: 171-246 Email: [email protected] WWW: http://sunset.usc.edu/~mattmann/ ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Adjunct Assistant Professor, Computer Science Department University of Southern California, Los Angeles, CA 90089 USA ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
