Hey Guys, OK, I created a Wiki page here with advice on how to leverage and use the LGPL licensed plugins:
https://cwiki.apache.org/confluence/display/OODT/OODT+Push+Pull+Plugins These are *NOT* official Apache OODT licensed code or released code. They are 2 plugins that wrap the LGPL based Ftp4Che and JvFTP FTP libraries using the Apache OODT protocol interface. They are use at your own risk, and not officially released or distributed from the Apache OODT PMC or from the ASF. Contributions of ALv2 compatible (licensed or Category friendly) FTP protocol plugins are welcomed and have the ability to be released as part of our software. I also linked the above wiki page from the main page. Cheers, Chris On Dec 28, 2011, at 3:07 PM, Mattmann, Chris A (388J) wrote: > Hey Cam, > > OK, I created an Apache Extras project here: > > http://code.google.com/a/apache-extras.org/p/oodt-pushpull-plugins/ > > You can download and use these plugins by doing: > > 1. svn export > http://svn.codespot.com/a/apache-extras.org/oodt-pushpull-plugins/trunk/ > oodt-pushpull-plugins > 2. cd oodt-pushpull-plugins > 3. mvn install > > Then you'll have a Jar file called > oodt-pushpull-plugins-core-0.4-SNAPSHOT.jar. > You can use it 2 days: > > 1. drop that Jar file into $PUSHPULL_HOME/lib, and then reference the new > FTP plugins in the PushPull Protocols.xml file. > 2. use it in your Maven2 project by adding a dependency on: > > <dependency> > <groupId>org.apache.oodt</groupId> > <artifactId>oodt-pushpull-plugins-core</artifactId> > <version>0.4-SNAPSHOT</version> > </dependency> > > If any of the OODT PMC/committers want to be made an admin > on this project at Apache Extras, let me know. > > Thanks! > > Cheers, > Chris > > On Dec 27, 2011, at 8:48 PM, Cameron Goodale wrote: > >> Brian, >> >> Thanks for the info. I don't have my eclipse setup properly to run that >> java file as an application so I will have to try that with some help from >> Paul or Chris next week perhaps. I looked up the regex for Java and the \w >> is supposed to be a word character matching alphanumeric and underscore. >> >> I ran my regex against this online tool I found and it seems to be a valid >> match. >> http://www.regexplanet.com/advanced/java/index.html >> Regex: TES-Aura_L2-CO2-Nadir_r\d{10}\w{2}\d{2}\w\d{2}\.he5 >> >> Input: TES-Aura_L2-CO2-Nadir_r0000002931_F06_08.he5 >> >> >> Thanks for the feedback and help on this. I have tried so many different >> tweaks with backslashes, etc. I am going to just walk away now and look at >> it later. >> >> >> -Cam >> >> >> On Tue, Dec 27, 2011 at 2:58 PM, Brian Foster <[email protected]> wrote: >> >>> Hey cameron... I think the problem is with ur >>> DirStructXmlParserFiles/TESL2CO2.xml file... for the file name regExp u are >>> specifying whitespace (i.e. \w instead of underscore)... pushpull looks >>> like it is behaving normally... it is acting like it is not finding any >>> files that match ur regExps... I wrote an app which may help u with your >>> regular expressions... in the pushpull util package in eclipse right click >>> on ExpressionValidator.java and Run As: Java Application... you can test >>> your regExp in the GUI that pops up. >>> >>> -brian >>> >>> Cameron Goodale <[email protected]> wrote: >>> >>>> Hey Devs, >>>> >>>> I have been working on building an OODT PushPull User Guide from an >>> Example >>>> I am trying to get working for a project, and I have encountered a little >>>> issue (at least I hope it is little). >>>> >>>> Here is the guide (work in progress): >>>> >>> https://cwiki.apache.org/confluence/display/OODT/OODT+Push-Pull+User+Guide >>>> >>>> The setups listed in the User Guide are the same ones I am working >>> against. >>>> Now here is the log messages I am seeing. >>>> >>>> Dec 27, 2011 10:59:00 AM org.apache.oodt.cas.pushpull.daemon.DaemonManager >>>> setAsRunning >>>> INFO: Daemon with ID = 91131 was given permission to run >>>> org.apache.oodt.cas.pushpull.filerestrictions.parsers.DirStructXmlParser >>>> Dec 27, 2011 10:59:00 AM >>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler isOkProtocol >>>> INFO: Testing protocol >>>> org.apache.oodt.cas.pushpull.protocol.ftp.CogJGlobusFtpClient . . . this >>>> may take a few minutes . . . >>>> Dec 27, 2011 10:59:00 AM org.apache.oodt.cas.pushpull.protocol.Protocol >>>> cdToHOME >>>> INFO: Changing to HOME directory 'ftp://l4ftl01.larc.nasa.gov/isDir=true' >>>> Dec 27, 2011 10:59:00 AM >>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler isOkProtocol >>>> SEVERE: Protocol >>>> org.apache.oodt.cas.pushpull.protocol.ftp.CogJGlobusFtpClient failed >>>> compatibility test : [CogJGlobusFtpClient] Failed to get list of files : >>>> Server refused performing the request. Custom message: (error code 1) >>>> [Nested exception message: Custom message: Unexpected reply: 500 'ORT >>>> 97,93,139,127,210,161': command not understood.] >>>> Dec 27, 2011 10:59:00 AM >>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler >>>> getAppropriateProtocolBySite >>>> WARNING: ProtocolFactory >>>> org.apache.oodt.cas.pushpull.protocol.ftp.CogJGlobusFtpClientFactory is >>> not >>>> compatible with server at ftp://l4ftl01.larc.nasa.gov >>>> Dec 27, 2011 10:59:01 AM >>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler isOkProtocol >>>> INFO: Testing protocol >>>> org.apache.oodt.cas.pushpull.protocol.ftp.CommonsNetFtpClient . . . this >>>> may take a few minutes . . . >>>> Dec 27, 2011 10:59:01 AM org.apache.oodt.cas.pushpull.protocol.Protocol >>>> cdToHOME >>>> INFO: Changing to HOME directory 'ftp://l4ftl01.larc.nasa.gov/isDir=true' >>>> Dec 27, 2011 10:59:02 AM org.apache.oodt.cas.pushpull.protocol.Protocol >>>> cdToROOT >>>> INFO: Changing to ROOT directory '/' >>>> Dec 27, 2011 10:59:02 AM org.apache.oodt.cas.pushpull.protocol.Protocol >>>> cdToHOME >>>> INFO: Changing to HOME directory 'ftp://l4ftl01.larc.nasa.gov/isDir=true' >>>> Dec 27, 2011 10:59:02 AM >>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler connect >>>> INFO: Successfully connected to ftp://l4ftl01.larc.nasa.gov with protocol >>>> 'org.apache.oodt.cas.pushpull.protocol.ftp.CommonsNetFtpClient' and >>>> username 'anonymous' >>>> Dec 27, 2011 10:59:02 AM org.apache.oodt.cas.pushpull.protocol.Protocol cd >>>> INFO: Changing to directory >>>> 'ftp://l4ftl01.larc.nasa.gov/TES/TL2CO2N.005isDir=true' >>>> PageSize: 8 PageLoc: 0 >>>> FileList size: 491 >>>> Dec 27, 2011 10:59:03 AM >>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler disconnect >>>> INFO: Disconnecting protocol from ftp://l4ftl01.larc.nasa.gov >>>> Dec 27, 2011 10:59:03 AM org.apache.oodt.cas.pushpull.daemon.Daemon sleep >>>> INFO: Daemon with ID = 91131 on RMI registry port 9113 is going to sleep >>>> until Tue Dec 27 11:00:00 PST 2011 >>>> >>>> >>>> First PushPull tries to use the CogJGlobusFtpClient and it encounters an >>>> error so it switches to CommonsNetFtpClient does a couple cd commands, >>>> connects successfully then disconnects and goes back to sleep. It will >>>> then wake up after the 3 minutes and repeat the same process. Has anyone >>>> seen this issue or have any suggestions for a fix? >>>> >>>> Thank you in advance. >>>> >>>> -Cameron >>>> >>>> P.S. If you have any feedback on the PushPull User Guide be sure to leave >>>> comments or make changes to the wiki. >>> > > > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > Chris Mattmann, Ph.D. > Senior Computer Scientist > NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA > Office: 171-266B, Mailstop: 171-246 > Email: [email protected] > WWW: http://sunset.usc.edu/~mattmann/ > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > Adjunct Assistant Professor, Computer Science Department > University of Southern California, Los Angeles, CA 90089 USA > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Chris Mattmann, Ph.D. Senior Computer Scientist NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Office: 171-266B, Mailstop: 171-246 Email: [email protected] WWW: http://sunset.usc.edu/~mattmann/ ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Adjunct Assistant Professor, Computer Science Department University of Southern California, Los Angeles, CA 90089 USA ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
